Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-1026

Expose original CSV and JSON data

          Details

          • Type: Improvement
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 1.1.0
          • Fix Version/s: None
          • Component/s: Data Module
          • Labels:

            Description

            The JSON and CSV readers will throw DatasetRecordException when an incoming record cannot be converted to the correct Avro schema. For example, if a CSV record has a non-numeric string in an integer field, the record is rejected but the reader can continue past it. For importing just the data that is valid, it would be nice to have a way to get the original CSV (or JSON) content to produce a file of just the failed records so they could be fixed and reprocessed.

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    blue Ryan Blue
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    1 Start watching this issue

                    Dates

                    • Created:
                      Updated: