Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-7563

[metastore] Fields in nested column have a leading comma when preceded by array in type struct

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.12.0, 4.1.0
    • Fix Version/s: 4.2.0
    • Component/s: app.catalog, con.hive
    • Labels:
      None

      Description

      In the Hive assist panel (in Hive Editor, Metastore, etc.), if you are navigating to a nested column to look at the fields, if a field in the nested column is preceded by a field that has a type of array like:

      fieldname:array<bigint>

      ...then the field directly following that one will have a comma preceding the field name in the assist panel like:

      ,fieldname

      The fieldname is also not callable in the Editor autocomplete due to this. However queries still work fine (using "fieldname" and not ",fieldname"), and running a DESCRIBE query on the nested column shows the field name correctly as "fieldname" instead of ",fieldname". So Hue is not parsing out the preceding comma when the preceding field is an array type.

      An example type for a nested column where this kind of problem is caused is a type like:

      struct<fieldname1:bigint,fieldname2:int,fieldname3:int,fieldname4:array<bigint>,fieldname5:bigint,fieldname6:array<struct<array_elem:string>>,fieldname7:string>

      In the case of the above type, it will look like the following in the assist panel:

      fieldname1
      fieldname2
      fieldname3
      fieldname4
      ,fieldname5
      fieldname6
      ,fieldname7

      ...when it should look like:

      fieldname1
      fieldname2
      fieldname3
      fieldname4
      fieldname5
      fieldname6
      fieldname7

        Attachments

          Activity

            People

            • Assignee:
              romain Romain Rigaux
              Reporter:
              rickbernotas Rick Bernotas
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: