Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-410

SchemaValidationUtil#hasErrors recursion bug

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.14.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      The FS SchemaValidationUtil#hasErrors method may receive recursive structures, so we need to keep track of visited nodes and exit. This is currently preventing customers from evolving schemas. The work-around is to update the schema by hand by replacing schema.avsc in a dataset's .metadata folder or for Hive, running one of these commands depending on whether avro.schema.literal or avro.schema.url is used:

      hive> alter table table_name set TBLPROPERTIES('avro.schema.literal'='<new schema literal>');
      hive> alter table table_name set TBLPROPERTIES('avro.schema.url'='hdfs:/schemas/updated_schema.avsc');
      

        Attachments

          Activity

            People

            • Assignee:
              tom Tom White
              Reporter:
              blue Ryan Blue
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: