Details
-
Type: Bug
-
Status: Resolved
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: 0.13.0
-
Fix Version/s: 0.14.0
-
Component/s: Data Module
-
Labels:None
Description
The FS SchemaValidationUtil#hasErrors method may receive recursive structures, so we need to keep track of visited nodes and exit. This is currently preventing customers from evolving schemas. The work-around is to update the schema by hand by replacing schema.avsc in a dataset's .metadata folder or for Hive, running one of these commands depending on whether avro.schema.literal or avro.schema.url is used:
hive> alter table table_name set TBLPROPERTIES('avro.schema.literal'='<new schema literal>'); hive> alter table table_name set TBLPROPERTIES('avro.schema.url'='hdfs:/schemas/updated_schema.avsc');