Pig or Hive won’t be the right tool for deleting data from mysql. You are better off triggering a separate mysql sql query for that.
You can take a look at project falcon – http://hortonworks.com/blog/project-falcon-tackling-hadoop-data-lifecycle-management-via-community-driven-open-source/ . It might help with this use case.
Hive / HCatalog Forum
Deleting data in MySql using Hive/Pig
Can we delete data in a external database(MySql etc) from Hadoop using Hive/Pig? I am trying to do Archival usecase as a POC for using Hadoop in our technology stack. I have to store data older than 6years into a hive table(incrementel load) and delete same data from the source table(in MySql). Kindly help on this, I am pity frustrated searching the web and getting resulta for importing data into Hadoop everytime??????
The forum ‘Hive / HCatalog’ is closed to new topics and replies.
Support from the Experts
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Become HDP Certified
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world