Oozie Forum

Hive query using Oozie is not successful

  • #33357
    Karthick S
    Member

    Hi,
    I have created a table new(id int). Now I am trying to update the table using hive via oozie. It does not throw any error but Hive actions keeps on going. Here are the related files
    WORKFLOW.XML:

    ${jobTracker}
    ${nameNode}

    <!–
    –>

    hive-site.xml

    mapred.job.queue.name
    ${queueName}

    oozie.log.hive.level
    DEBUG

    oozie.hive.defaults
    hive-site.xml

    script.q

    Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]

    Configuration:
    jobTracker sandbox:50300
    nameNode hdfs://sandbox:8020
    oozie.libpath /user/oozie/share/lib/hive
    oozie.use.system.libpath true
    oozie.wf.application.path hdfs://sandbox:8020/user/hue/demo2
    queueName default
    user.name hue

    SCRIPT.Q
    load data inpath ‘demo1/data.txt’ into new;

    Log from the job:
    2013-08-27 03:07:12,903 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:14,717 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:16,679 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:32,234 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]
    2013-08-27 03:07:45,982 DEBUG DefinitionXCommand:545 – USER[hue] GROUP[-] TOKEN[] APP[hive-add-wf] JOB[0000002-130826232141308-oozie-oozi-W] ACTION[-] Execute command [definition] key [0000002-130826232141308-oozie-oozi-W]

    Thanks in advance.
    Karthick

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #33358
    Karthick S
    Member

    For some reason the workflow.xml did not get pasted right: So once again pasting it here,

    ${jobTracker}
    ${nameNode}

    <!–
    –>

    hive-site.xml

    mapred.job.queue.name
    ${queueName}

    oozie.log.hive.level
    DEBUG

    oozie.hive.defaults
    hive-site.xml

    script.q

    Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]

    #33513
    Karthick S
    Member

    The same setup above worked successfully with the query:
    insert overwrite table new_col select col1 from cor;

    Probably the issue is with the way query is framed. Will update the exact issue once i get more clarity

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.