Uploaded image for project: 'CDH'
  1. CDH
  2. DISTRO-521

NoSuchElementException in Sqoop Merge

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: CDH4.3.0
    • Fix Version/s: None
    • Component/s: Sqoop
    • Labels:
    • Environment:
      CentOS 6.1 and Java 1.6
      Sqoop Version: 1.4.3-cdh4.3.0

      Description

      I use sqoop import to load initial full snapshot and daily incremental data. Once the data is in HDFS, I merge them with sqoop merge to get daily snapshot. Merge works fine for 12 of 17 DB2 tables. And I got the similar exception for the rest:
      13/09/09 10:59:50 INFO mapred.JobClient: Task Id : attempt_201308211622_0171_m_000033_0, Status : FAILED
      java.util.NoSuchElementException
      at java.util.AbstractList$Itr.next(AbstractList.java:350)
      at ORDERITEMS.__loadFromFields(ORDERITEMS.java:1916)
      at ORDERITEMS.parse(ORDERITEMS.java:1735)
      at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
      at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      at org.apache.hadoop.mapred.Child.main(Child.java:262)

      Is this a bug for merge tool? It seems to be data related since not all table merges fail. All data are imported by sqoop import tool. Thanks.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wayne2chicago Wayne
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated: