Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-519

Package org.apache.hadoop.mapreduce.lib.chain is missing from hadoop-core JAR files

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Not A Bug
          • Affects Version/s: CDH4.3.1
          • Fix Version/s: None
          • Component/s: MapReduce
          • Labels:

            Description

            Javadoc for the Apache Hadoop 2.0.0-cdh4.3.1 API [link] contains a description of a ChainMapper class within org.apache.hadoop.mapreduce.lib.chain package [link]. The problem is that org.apache.hadoop.mapreduce.lib.chain package is not present in a hadoop-core-2.0.0-mr1-cdh4.3.1.jar file (as well as any other hadoop-core JAR files) in Cloudera repository [link].

            The only ChainMapper and ChainReducer classes that are available within mentioned JARs are these from org.apache.hadoop.mapred.lib package (the old API package). That makes it impossible to use the new API (from mapreduce package) when dealing with job chaining, because ChainMapper constructor from the old API cannot take the new API Job object as an argument (only JobConf is allowed).

            I think that some backport, especially for hadoop-core-2.0.0-mr1-cdh4.3.1, could solve that problem.

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    falconepl Przemyslaw Sokol
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    0 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: