Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-745

Sqoop incremental load using "lastmodified" fails when going against MSSQL

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: CDH 5.4.2
    • Fix Version/s: None
    • Component/s: Sqoop
    • Labels:

      Description

      Team,

      Not sure if I missed anything here, please feel free to correct me.

      I'm on Sqoop version: 1.4.5-cdh5.4.2.

      Trying to execute the following Sqoop Job:
      sqoop job --create test - import --check-column UpdatedDT --incremental lastmodified --last-value 1900-01-01 --connect 'jdbc:sqlserver://x.x.x.x:1433;databaseName=test' --username user --password password --table "Application.Test" --driver=com.microsoft.sqlserver.jdbc.SQLServerDriver -m 1 --hive-import --hive-table hivedb.Test

      Also, I have the sqljdbc4.jar in /usr/lib/sqoop/lib/

      And I'm hitting this error.
      15/07/22 04:27:00 ERROR manager.SqlManager: SQL exception accessing current timestamp: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
      com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
      at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.doExecuteStatement(SQLServerStatement.java:792)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement$StmtExecCmd.doExecute(SQLServerStatement.java:689)
      at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696)
      at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeQuery(SQLServerStatement.java:616)
      at org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp(SqlManager.java:963)
      at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:328)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
      at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
      at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:228)
      at org.apache.sqoop.tool.JobTool.run(JobTool.java:283)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      15/07/22 04:27:00 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Could not get current time from database
      at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:330)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
      at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
      at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:228)
      at org.apache.sqoop.tool.JobTool.run(JobTool.java:283)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

      Please advice.

      Ref: https://issues.cloudera.org/browse/SQOOP-229

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ananth.n.pal Ananth Pal
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: