Details
-
Type: Sub-task
-
Status: Resolved
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: 0.17.0
-
Fix Version/s: 0.17.1
-
Component/s: None
-
Labels:None
Description
There are several problems with CSV schema validation:
1. If the header is not present or not used, the field names will not match
2. If types have been fixed and are more restrictive, validation will fail
Also, a schema is always inferred, even if the validation check is turned off.
Instead of getting a schema for the data and then validating it, CSV should simply validate that the given schema appears to be valid for the file.
Attachments
Issue Links
- blocks
-
KITE-563 CSV import task schema check fails without header line
- Resolved
-
KITE-768 csv-import should use headers to define fields
- Resolved
- depends on
-
KITE-797 Read CSV fields by header, if present
- Resolved
- relates to
-
KITE-801 Numeric CSV fields should throw exceptions with invalid data
- Resolved