The Hortonworks Community Connection is now live. A completely rebuilt Q&A forum, Knowledge Base, Code Hub and more, backed by the experts in the industry.

You will be redirected here in 10 seconds. If your are not redirected, click here to visit the new site.

The legacy Hortonworks Forum is now closed. You can view a read-only version of the former site by clicking here. The site will be taken offline on January 31,2016

Oozie Forum

sqoop job run via oozie

  • #30134
    Member

    Does anyone can run sqoop job via oozie successfully?
    I create a sqoop job to import data from oracle incremental by id,the command is :
    sqoop job –create stujob — import –hive-import –connect jdbc:oracle:thin:@192.168.1.8:1521:ORCL –username SCOTT –password tiger -m 1 –table STUDENT –check-column SID –incremental append –last-value 0
    then I can run bin/sqoop job –exec stujob successfully,but the task can’t run successfully via oozie

    Controller.doPrivileged(AccessController.java:310)
    at javax.security.auth.Subject.doAs(Subject.java:573)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
    at org.apache.hadoop.mapred.Child.main(Child.java:249)
    2098 [main] ERROR org.apache.sqoop.manager.OracleManager – Failed to list columns
    java.sql.SQLException: ORA-01005: null password given; logon denied

    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:391)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:383)
    at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:638)
    at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthenticate.java:433)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:459)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:193)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:365)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:804)
    at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:386)
    at oracle.jdbc.driver.PhysicalConnection.(PhysicalConnection.java:535)
    at oracle.jdbc.driver.T4CConnection.(T4CConnection.java:218)
    at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:29)
    at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528)

    It seems that the oozie can’t know the password of the oracle define in the job,the document said :you have to set sqoop.metastore.client.record.password to true if you are executing saved jobs via Oozie because Sqoop cannot prompt the user to enter passwords while being executed as Oozie tasks.
    I do have set the sqoop.metastore.client.record.password to be true

    sqoop.metastore.client.record.password
    true
    If true, allow saved passwords in the metastore.

  • Author
    Replies
  • #30174
    Member
    #30411
    Robert
    Participant

    Hi Member,
    Thanks for posting your answer. It will help others in the community.

    Regards,
    Robert

The forum ‘Oozie’ is closed to new topics and replies.

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.