Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-424

Sqoop export to Netezza fails with --direct option

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Not A Bug
    • Affects Version/s: CDH4.0.0
    • Fix Version/s: None
    • Component/s: Sqoop
    • Labels:
    • Environment:
      Netezza: 6.0.3-0.F-1.P-5.Bld-20482
      Sqoop: 1.4.1-cdh4.0.1
      MapReduce: v1
      OS: Oracle Linux Server release 6.3

      Description

      Using without the --direct option works, but uses single inserts (not okay on NZ.)

      Sqoop call:

      import org.apache.sqoop.Sqoop;
      ...
      Sqoop.runTool(new String[]

      { "export", "--connect", connection, "--table", tableName, "--direct", "--export-dir", file, "--input-fields-terminated-by", ",", "--lines-terminated-by", "\n"}

      , jobConf);

      Stdout:

      12/08/14 17:18:36 INFO manager.SqlManager: Using default fetchSize of 1000
      12/08/14 17:18:36 INFO tool.CodeGenTool: Beginning code generation
      12/08/14 17:18:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM CAMPAIGN_ANALYSIS_60 AS t WHERE 1=0
      12/08/14 17:18:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM CAMPAIGN_ANALYSIS_60 AS t WHERE 1=0
      12/08/14 17:18:36 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop
      Note: /tmp/sqoop-hduser/compile/1dbc102fd64aaaafb1f81df148a59ead/CAMPAIGN_ANALYSIS_60.java uses or overrides a deprecated API.
      Note: Recompile with -Xlint:deprecation for details.
      12/08/14 17:18:46 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hduser/compile/1dbc102fd64aaaafb1f81df148a59ead/CAMPAIGN_ANALYSIS_60.jar
      Exception in thread "main" java.lang.NoSuchMethodError: com.cloudera.sqoop.manager.ExportJobContext.setConnManager(Lcom/cloudera/sqoop/manager/ConnManager;)V
      at com.cloudera.sqoop.netezza.DirectNetezzaManager.exportTable(DirectNetezzaManager.java:67)
      at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:78)
      at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:97)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
      at blah.CampaignAnalysisTable.load(CampaignAnalysisTable.java:141)
      at blah.CampaignAnalysisDriver.run(CampaignAnalysisDriver.java:78)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
      at blah.CampaignAnalysisDriver.main(CampaignAnalysisDriver.java:36)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              devoncrouse@gmail.com Devon Crouse
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: