Details
-
Type: Sub-task
-
Status: Resolved
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: 0.15.0
-
Fix Version/s: 0.15.0
-
Component/s: Command-line Interface, Data Module
-
Labels:None
Description
The current copy task is map-only, so it produces one output file per input split. We need to add a reduce phase to really support compaction, which uses the internal FS StorageKey to send records to the reduce phase.