Uploaded image for project: 'Kite SDK'
  1. Kite SDK
  2. KITE-374 Support for data compaction util
  3. KITE-488

Add reducers to copy task to control the number of output files

    Details

      Description

      The current copy task is map-only, so it produces one output file per input split. We need to add a reduce phase to really support compaction, which uses the internal FS StorageKey to send records to the reduce phase.

        Attachments

          Activity

            People

            • Assignee:
              blue Ryan Blue
              Reporter:
              blue Ryan Blue
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: