Uploaded image for project: 'Kite SDK'
  1. Kite SDK
  2. KITE-175

Add schema translation from Avro to Hive columns

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      The Parquet InputFormat that works with both Hive and Impala, parquet.hive.DeprecatedParquetInputFormat, doesn't understand avro schemas. There is code in parquet-hive to translate from Hive's column descriptions to a Parquet MessageType. To get the table schema to Hive and Impala, we need to translate from an avro schema to Hive's FieldSchema and TypeInfo objects.

        Attachments

          Activity

            People

            • Assignee:
              blue Ryan Blue
              Reporter:
              blue Ryan Blue
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: