Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-561

Hive 0.11.0 is not working with mr1-2.0.0-mr1-cdh4.2.1

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Not A Bug
    • Affects Version/s: CDH4.2.0, CDH4.2.1, CDH4.3.0
    • Fix Version/s: None
    • Component/s: Hive
    • Labels:
    • Environment:
      OS: Red Hat Enterprise Linux Server release 6.2
      HDFS: CDH-4.2.1
      MAPRED: CDH-4.2.1-mr1

      Description

      first,we should copy hadoop-mapreduce-client-core-2.0.0-cdh4.2.1.jar which exists in "hadoop-2.0.0-cdh4.2.1\share\hadoop\mapreduce " into "hadoop-2.0.0-mr1-cdh4.2.1\lib" ;then,it will throw exception when we execute hql which calls mapreduce.
      The exception is shown below:
      Diagnostic Messages for this Task:
      java.lang.RuntimeException: java.lang.NullPointerException
      at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:230)
      at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
      at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
      at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
      at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:540)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:395)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      at org.apache.hadoop.mapred.Child.main(Child.java:262)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ruishlee li ruisheng
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: