Pig Date and Time Issue
i still dont feel very familiar with pig and the mapreduce funktions, so please help me with that issue.
What i got and what i want:
I got a hugh logfile with the following format: Date (21.12.2012), Time(12:33:59), UserName(Dude1), IPAdress;
My issue is to check, if somebody changed his ip adress in less then 5 seconds:
31.12.2012 12:33:59 Dude1 18.104.22.168
31.12.2012 12:34:02 Dude1 22.214.171.124
31.12.2012 12:34:05 Dude1 321.321.321.321
This third row should give me an alert. But how can i compare several rows with each other to find out, if there is a ip change in less then 5 second? Does someone have an idea?
Support from the Experts
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Become HDP Certified
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world