Oozie Forum

sqoop job run via oozie

  • #30134

    Does anyone can run sqoop job via oozie successfully?
    I create a sqoop job to import data from oracle incremental by id,the command is :
    sqoop job –create stujob — import –hive-import –connect jdbc:oracle:thin:@ –username SCOTT –password tiger -m 1 –table STUDENT –check-column SID –incremental append –last-value 0
    then I can run bin/sqoop job –exec stujob successfully,but the task can’t run successfully via oozie

    at javax.security.auth.Subject.doAs(Subject.java:573)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
    at org.apache.hadoop.mapred.Child.main(Child.java:249)
    2098 [main] ERROR org.apache.sqoop.manager.OracleManager – Failed to list columns
    java.sql.SQLException: ORA-01005: null password given; logon denied

    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:391)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:383)
    at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:638)
    at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthenticate.java:433)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:459)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:193)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:365)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:804)
    at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:386)
    at oracle.jdbc.driver.PhysicalConnection.(PhysicalConnection.java:535)
    at oracle.jdbc.driver.T4CConnection.(T4CConnection.java:218)
    at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:29)
    at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528)

    It seems that the oozie can’t know the password of the oracle define in the job,the document said :you have to set sqoop.metastore.client.record.password to true if you are executing saved jobs via Oozie because Sqoop cannot prompt the user to enter passwords while being executed as Oozie tasks.
    I do have set the sqoop.metastore.client.record.password to be true

    If true, allow saved passwords in the metastore.

to create new topics or reply. | New User Registration

  • Author
  • #30174

    Hi Member,
    Thanks for posting your answer. It will help others in the community.


You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.