Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-602

Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: CDH4.4.0
    • Fix Version/s: None
    • Component/s: Hive, MapReduce, Sqoop
    • Labels:
    • Environment:
      4 node cluster installed using cloudera manager.

      Description

      Tried to export a hive external table to mysql using sqoop hcatalog export command.

      sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234 bd_sqoop1 --hcatalog-table test_data

      I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception as below:

      14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1, Status : FAILED
      java.io.IOException: Error initializing HCat record reader
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
      at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      at org.apache.hadoop.mapred.Child.main(Child.java:262)
      Caused by: java.io.IOException: Failed to load foster storage handler
      at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
      at org.apache.hcatalog.common.HCatUtil.getStorageHandl

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              souvik Souvik Bose
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: