MapReduce Execution

to create new topics or reply. | New User Registration

This topic contains 1 reply, has 2 voices, and was last updated by  Larry Liu 2 years ago.

  • Creator
    Topic
  • #24184

    Hi,

    My question is general, regarding mapreduce job execution. Suppose I typed in a hive query, ultimately query it processes is using mapreduce only which will take few seconds and show us the results. But if I type a same query why it runs mapreduce again? Cant’ we reuse something to avoid re-execution?

    Thanks
    Saurabh

Viewing 1 replies (of 1 total)

The topic ‘MapReduce Execution’ is closed to new replies.

  • Author
    Replies
  • #24228

    Larry Liu
    Moderator

    Hi, Saurabh

    I think in this scenario, I would recommend you to use Sqoop to export the Hive query output if your purpose is to save the output.

    Larry

    Collapse
Viewing 1 replies (of 1 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.