Details
-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Won't Fix
-
Affects Version/s: CDH 5.4.2
-
Fix Version/s: None
-
Component/s: HDFS
-
Labels:None
Description
We want to copy over data from a CDH4 to a CDH5 cluster with DistCP.
Currently HFTP is not working on our secure clusters because the DT mechanism has been disabled for HFTP in CDH5 client libraries.
Even though HFTP is going the way of the dodo (https://issues.apache.org/jira/browse/HDFS-5570), I think that supporting HFTP in CDH5 makes some sense for Cloudera which does maintenance releases.
Typically we haven't enabled webhdfs on our CDH4 cluster, and enabling it to go through webhdfs is really painful.
The patch to enable DT implementation for HFTP is really simple:
https://github.com/criteo-forks/hadoop-common/commit/200cb23423ada43e5300fcc407cd2667533c2cce
Please consider including the fix; i've not submitted it to mainline, as I know it will be rejected – there's no maintenance release.