Home Forums Sqoop java.lang.AbstractMethodError: org.netezza.sql.NzPreparedStatament.isClosed()Z

Tagged: ,

This topic contains 3 replies, has 2 voices, and was last updated by  Carsten Piepel 2 months, 3 weeks ago.

  • Creator
    Topic
  • #59524

    Carsten Piepel
    Participant

    I am using HDP 2.0.6.0 for Windows. When attempting to import data from a Netezza appliance using Sqoop, the MapReduce job fails with the Netezza JDBC error shown below:


    2014-08-29 14:24:00,467 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@3d989dea
    2014-08-29 14:24:00,807 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: "SITE_ID" >= 1 AND "SITE_ID" < 100413
    2014-08-29 14:24:00,860 INFO [main] org.apache.sqoop.mapreduce.db.DBRecordReader: Working on split: "SITE_ID" >= 1 AND "SITE_ID" < 100413
    2014-08-29 14:24:00,923 INFO [main] org.apache.sqoop.mapreduce.db.DBRecordReader: Executing query: SELECT "VP_ID", "BR_ID", "ACCOUNT_ID", "SITE_ID", "X", "Y" FROM "BR_SITE_LOCATION_V" AS "BR_SITE_LOCATION_V" WHERE ( "SITE_ID" >= 1 ) AND ( "SITE_ID" < 100413 )
    2014-08-29 14:24:19,104 INFO [Thread-11] org.apache.sqoop.mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
    2014-08-29 14:24:19,155 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.AbstractMethodError: org.netezza.sql.NzPreparedStatament.isClosed()Z
    at org.apache.sqoop.mapreduce.db.DBRecordReader.close(DBRecordReader.java:163)
    at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.close(MapTask.java:499)
    at org.apache.hadoop.mapred.MapTask.closeQuietly(MapTask.java:1982)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:772)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)

    I use the following import command:


    sqoop import --username map -P --connect jdbc:netezza://nzhost:5480/nzdb --table BR_SITE_LOCATION_V --split-by SITE_ID --target-dir /user/coz323/br-site --verbose

    I’ve tried the Netezza JDBC drivers versions 5.0 and 7.0 but the error is the same for both. Using the –direct option also does not make a difference. I am confident Sqoop is using the correct connection manager as I see the following lines logged to the console:


    manager.DefaultManagerFactory: Trying with scheme: jdbc:netezza:
    sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.NetezzaManager@3595b750

    Any ideas or suggestions would be highly appreciated. Thanks.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘java.lang.AbstractMethodError: org.netezza.sql.NzPreparedStatament.isClosed()Z’ is closed to new replies.

  • Author
    Replies
  • #59584

    Carsten Piepel
    Participant

    Thanks, that did it: I installed Hortonworks Data Platform 2.1.3.0 for Windows and the sqoop import from Netezza is working now.

    Collapse
    #59545

    Carsten Piepel
    Participant

    Thanks, Venkat. I will give that a try and report back.

    Collapse
    #59539

    Venkat Ranganathan
    Participant

    The root cause is described in SQOOP-1279. I think the 2.0.6.0 product does not have the right Sqoop version. Can you get the later version of HDP and try

    Thanks
    Venkat

    Collapse
Viewing 3 replies - 1 through 3 (of 3 total)