Uploaded image for project: 'Sqoop (READ-ONLY)'
  1. Sqoop (READ-ONLY)
  2. SQOOP-44

Sqoop argument "--columns" causes NullPointerException if case is not correct for Oracle

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.1.0
    • Component/s: import
    • Labels:
      None
    • Environment:
      Client OS: Linux Fedora 13, 64-bit
      Client Oracle JDBC driver: ojdbc6.jar

      Hadoop: 0.20.2+320

      Description

      (1) Perform a sqoop import for an oracle table and specify the column names via the "--columns" argument:
      sqoop import --connect jdbc:oracle:thin:@<server>:<port>:<service> --username <user> --password <password> --table table5 --split-by col_number --columns "col_number" --verbose

      (2)
      The following error is encountered:
      10/08/02 14:17:28 INFO tool.CodeGenTool: Beginning code generation
      10/08/02 14:17:28 DEBUG manager.OracleManager: Creating a new connection for jdbc:oracle:thin:@machine:port:service/user
      10/08/02 14:17:29 INFO manager.OracleManager: Time zone has been set to GMT
      10/08/02 14:17:29 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table5 t WHERE 1=0
      10/08/02 14:17:29 DEBUG orm.ClassWriter: selected columns:
      10/08/02 14:17:29 DEBUG orm.ClassWriter: col_number

      10/08/02 14:17:29 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
      java.lang.NullPointerException
      at com.cloudera.sqoop.orm.ClassWriter.generateFields(ClassWriter.java:430)
      at com.cloudera.sqoop.orm.ClassWriter.generateClassForColumns(ClassWriter.java:1081)
      at com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:955)
      at com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
      at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:85)
      at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:161)
      at com.cloudera.sqoop.Sqoop.run(Sqoop.java:134)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:170)
      at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:196)
      at com.cloudera.sqoop.Sqoop.main(Sqoop.java:205)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:616)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:186)

      The problem is that during ClassWriter.generate(), the "cleaned" column names do not retain their column type.
      i.e. The 2nd parameter in this call is null...
      columnTypes.put(identifier, columnTypes.get(col));

      This is not a problem if the correct case for the column name is used on the sqoop command-line.
      i.e. Oracle column names are actually upper-case by default.

        Attachments

          Activity

            People

            • Assignee:
              aaron Aaron Kimball
              Reporter:
              guylemar Guy le Mar
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: