Details

      Description

      Flume failures when streaming records into datasets will create orphaned temporary files with records that are no longer in flume channels. The recovery plan is to read these files/records and correctly insert them into the dataset, up through the last complete block in the avro file (the last successful flush). Kite should provide a utility to find and recover those records.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                blue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: