Details
-
Type:
Improvement
-
Status: Open
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: 0.14.1
-
Fix Version/s: None
-
Component/s: Command-line Interface, Data Module
-
Labels:
Description
Flume failures when streaming records into datasets will create orphaned temporary files with records that are no longer in flume channels. The recovery plan is to read these files/records and correctly insert them into the dataset, up through the last complete block in the avro file (the last successful flush). Kite should provide a utility to find and recover those records.
Attachments
Issue Links
- relates to
-
KITE-492 Add Parquet appender that uses Avro for durability
-
- Resolved
-