The Hortonworks Community Connection is now live. A completely rebuilt Q&A forum, Knowledge Base, Code Hub and more, backed by the experts in the industry.

You will be redirected here in 10 seconds. If your are not redirected, click here to visit the new site.

The legacy Hortonworks Forum is now closed. You can view a read-only version of the former site by clicking here. The site will be taken offline on January 31,2016

Oozie Forum

Hive query using Oozie is not successful

  • #33357
    Karthick S
    Member

    Hi,
    I have created a table new(id int). Now I am trying to update the table using hive via oozie. It does not throw any error but Hive actions keeps on going. Here are the related files
    WORKFLOW.XML:

    ${jobTracker}
    ${nameNode}

    <!–
    –>

    hive-site.xml

    mapred.job.queue.name
    ${queueName}

    oozie.log.hive.level
    DEBUG

    oozie.hive.defaults
    hive-site.xml

    script.q

    Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]

    Configuration:
    jobTracker sandbox:50300
    nameNode hdfs://sandbox:8020
    oozie.libpath /user/oozie/share/lib/hive
    oozie.use.system.libpath true
    oozie.wf.application.path hdfs://sandbox:8020/user/hue/demo2
    queueName default
    user.name hue

    SCRIPT.Q
    load data inpath ‘demo1/data.txt’ into new;

    Log from the job:
    2013-08-27 03:07:12,903 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:14,717 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:16,679 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:32,234 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:45,982 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]

    Thanks in advance.
    Karthick

  • Author
    Replies
  • #33358
    Karthick S
    Member

    For some reason the workflow.xml did not get pasted right: So once again pasting it here,

    ${jobTracker}
    ${nameNode}

    <!–
    –>

    hive-site.xml

    mapred.job.queue.name
    ${queueName}

    oozie.log.hive.level
    DEBUG

    oozie.hive.defaults
    hive-site.xml

    script.q

    Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]

    #33513
    Karthick S
    Member

    The same setup above worked successfully with the query:
    insert overwrite table new_col select col1 from cor;

    Probably the issue is with the way query is framed. Will update the exact issue once i get more clarity

The forum ‘Oozie’ is closed to new topics and replies.

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.