Hive / HCatalog Forum

Deleting data in MySql using Hive/Pig

  • #44575

    Can we delete data in a external database(MySql etc) from Hadoop using Hive/Pig? I am trying to do Archival usecase as a POC for using Hadoop in our technology stack. I have to store data older than 6years into a hive table(incrementel load) and delete same data from the source table(in MySql). Kindly help on this, I am pity frustrated searching the web and getting resulta for importing data into Hadoop everytime??????

to create new topics or reply. | New User Registration

  • Author
  • #44614
    Thejas Nair

    Pig or Hive won’t be the right tool for deleting data from mysql. You are better off triggering a separate mysql sql query for that.
    You can take a look at project falcon – . It might help with this use case.

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.