Home Forums Hive / HCatalog Deleting data in MySql using Hive/Pig

This topic contains 1 reply, has 2 voices, and was last updated by  Thejas Nair 9 months, 2 weeks ago.

  • Creator
    Topic
  • #44575

    Can we delete data in a external database(MySql etc) from Hadoop using Hive/Pig? I am trying to do Archival usecase as a POC for using Hadoop in our technology stack. I have to store data older than 6years into a hive table(incrementel load) and delete same data from the source table(in MySql). Kindly help on this, I am pity frustrated searching the web and getting resulta for importing data into Hadoop everytime??????

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #44614

    Thejas Nair
    Participant

    Pig or Hive won’t be the right tool for deleting data from mysql. You are better off triggering a separate mysql sql query for that.
    You can take a look at project falcon – http://hortonworks.com/blog/project-falcon-tackling-hadoop-data-lifecycle-management-via-community-driven-open-source/ . It might help with this use case.

    Collapse
Viewing 1 replies (of 1 total)