Uploaded image for project: 'Sqoop (READ-ONLY)'
  1. Sqoop (READ-ONLY)
  2. SQOOP-206

HBase import does not use InputFormat specified by plugin

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.3.0
    • Component/s: hbase
    • Labels:
      None
    • Environment:
      Tested with sqoop-1.2.0-cdh3u0, hbase-0.90.1-cdh3u0, hadoop-0.20.2-CDH3B4

      Description

      Attempting to perform a HBase import using Quest® Data Connector for Oracle and Hadoop (formerly known as Oraoop) causes an IOException. Cause appears to be use of DataDrivenDBInputFormat.class in HBaseImportJob initialisation instead of importContext.getInputFormat(). Will submit a patch once I've confirmed the cause. Stack trace follows.

      11/05/19 12:23:46 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: ORA-00936: missing expression

      at com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:201)
      at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944)
      at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:961)
      at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:476)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:506)
      at com.cloudera.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:107)
      at com.cloudera.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:166)
      at com.cloudera.sqoop.manager.SqlManager.importTable(SqlManager.java:386)
      at com.quest.oraoop.OraOopConnManager.importTable(OraOopConnManager.java:255)
      at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:350)
      at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
      at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
      at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
      at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)

        Attachments

          Activity

            People

            • Assignee:
              phall Peter Hall
              Reporter:
              phall Peter Hall
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: