Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-974

Hive table DDLs not updated when dataset schema is updated.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      If a dataset is updated with a new schema the HIVE DDL columns are not kept in sync. The avro.schema.url is correctly updated.

      Either they should be kept in sync or only the avro.schema.url should be used (not sure what impala does here with a parquet backed table).

      Add

      // convert the schema to Hive columns
      table.getSd().setCols(HiveSchemaConverter.convertSchema(descriptor.getSchema()));

      to HiveUtils.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                andrew.stevenson Andrew Stevenson
                Reporter:
                andrew.stevenson Andrew Stevenson
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: