Sqoop Incremental import from SQL Server failing

to create new topics or reply. | New User Registration

This topic contains 0 replies, has 1 voice, and was last updated by  Rick Buchan 1 year, 9 months ago.

  • Creator
  • #39168

    Rick Buchan

    In the 2.0 Sandbox, we are getting an error attempting to execute a sqoop incremental import using the lastmodified parameter when pulling data from SQL Server. The same command works fine using the append parameter.

    13/10/02 11:56:55 WARN manager.SqlManager: SQL exception accessing current timestamp: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ‘)’.
    13/10/02 11:56:55 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Could not get current time from database

    Here is the command which was issued:

    [root@sandbox ~]# sqoop import –connect “jdbc:sqlserver://;database=xxxxxx” –username xxxxx –password xxxxxx –driver com.microsoft.sqlserver.jdbc.SQLServerDriver –table “dbo.xxxxxx” –target-dir “xxxxxxx” –incremental “lastmodified” –check-column “LAST_UPD” –last-value “2013-09-20 04:02:03″ –split-by ROW_ID –m 1

    Log also included this statement:
    13/10/02 11:56:46 WARN sqoop.ConnFactory: Parameter –driver is set to an explicit driver however appropriate connection manager is not being set (via –connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.

    Is there a way around this error?


You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.