sqoop job run via oozie

to create new topics or reply. | New User Registration

This topic contains 2 replies, has 2 voices, and was last updated by  Robert 2 years ago.

  • Creator
    Topic
  • #30134


    Member

    Does anyone can run sqoop job via oozie successfully?
    I create a sqoop job to import data from oracle incremental by id,the command is :
    sqoop job –create stujob — import –hive-import –connect jdbc:oracle:thin:@192.168.1.8:1521:ORCL –username SCOTT –password tiger -m 1 –table STUDENT –check-column SID –incremental append –last-value 0
    then I can run bin/sqoop job –exec stujob successfully,but the task can’t run successfully via oozie

    Controller.doPrivileged(AccessController.java:310)
    at javax.security.auth.Subject.doAs(Subject.java:573)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
    at org.apache.hadoop.mapred.Child.main(Child.java:249)
    2098 [main] ERROR org.apache.sqoop.manager.OracleManager – Failed to list columns
    java.sql.SQLException: ORA-01005: null password given; logon denied

    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:391)
    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:383)
    at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:638)
    at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthenticate.java:433)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:459)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:193)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:365)
    at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:804)
    at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:386)
    at oracle.jdbc.driver.PhysicalConnection.(PhysicalConnection.java:535)
    at oracle.jdbc.driver.T4CConnection.(T4CConnection.java:218)
    at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:29)
    at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528)

    It seems that the oozie can’t know the password of the oracle define in the job,the document said :you have to set sqoop.metastore.client.record.password to true if you are executing saved jobs via Oozie because Sqoop cannot prompt the user to enter passwords while being executed as Oozie tasks.
    I do have set the sqoop.metastore.client.record.password to be true

    sqoop.metastore.client.record.password
    true
    If true, allow saved passwords in the metastore.

Viewing 2 replies - 1 through 2 (of 2 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #30411

    Robert
    Participant

    Hi Member,
    Thanks for posting your answer. It will help others in the community.

    Regards,
    Robert

    Collapse
    #30174


    Member
    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.