Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-420

DistCpV2 is not in MRv1 of CDH4. It is only included with YARN in CDH4

          Details

          • Type: Task
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: CDH4.1.0
          • Fix Version/s: None
          • Component/s: MapReduce
          • Labels:

            Description

            In hadoop-2.0.0-mr1-cdh4.0.1, disctcp is not upgraded to the latest version V2 as in hadoop-2.0.0-cdh4.0.1. This new version V2 of the reengineered distcp is part of Hadoop 0.23.1 for example. We need some of the new features of DistCpV2 such as wild card support and being able to get the Job ID. As you know, DistCpV2 already provides a new method DistCp::execute() that returns the MapReduce job generated by distcp. We can then retrieve the jobID from that returned job. This is needed in our current flow. Could you please let us know when DisctCpV2 will be available in MRv1 of CDH4?

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    sbaltagi Slim Baltagi
                  • Votes:
                    1 Vote for this issue
                    Watchers:
                    3 Start watching this issue

                    Dates

                    • Created:
                      Updated: