Uploaded image for project: 'Kite SDK'
  1. Kite SDK
  2. KITE-1121

Don't require .metadata for Parquet files

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Bug
    • Affects Version/s: 1.0.0
    • Fix Version/s: None
    • Component/s: Data Module
    • Labels:
    • Environment:
      CDH 5.5.2
      Sqoop 1.4.6
      Parquet 1.5.0
      parquet-format 2.1.0

      Description

      Kite currently requires .metadata.
      Parquet files have their own metadata stored along data files.
      It would be great for Export operation on parquet files to RDBMS not to require .metadata.
      We have most of the files created by Spark and Hive, and they don't create .metadata, it only Kite that does.
      It makes sqoop/kite export of parquet files usability very limited.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tagar Ruslan Dautkhanov
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: