Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-1016

DatasetKeyOutputFormat writes to target dataset

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      When the DatasetKeyOutputFormat is configured using a dataset instance, the dataset's location is set as kite.outputPartitionDir for compatibility with partitioned datasets. There is a check to verify that the output dataset actually is a partition in getRecordWriter, but this check isn't quite correct. It will assume that any non-null location is a partition within a dataset.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                blue Ryan Blue
                Reporter:
                blue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: