Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2280

[metastore] Partitions names are not always correct

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.6.0
    • Fix Version/s: 3.9.0
    • Component/s: app.catalog
    • Labels:
    • Environment:

      CDH5.1 using an external metastore on postgresql. External Hive table with partitions.

      Description

      When I use the function "Show Partitions" in the Metastore Manager I get presented with a list of the available partitions but it seems like the path presented is not correct in my case.

      I create a partition like so:
      ALTER TABLE MyTable ADD PARTITION (part_col=1234) location '/x/y/z/1/1234';

      Hue shows me the following path to the created partition:
      hdfs://myhost.com:8020/x/y/z/part_col=1234

      The correct path to the partition is:
      hdfs://myhost.com:8020/x/y/z/1/1234

      If I follow the path link it points me to a folder that does not exist.

      My create table statement looks like so:
      CREATE EXTERNAL TABLE IF NOT EXISTS MyTable (
      field STRING)
      PARTITIONED BY (part_col INT)
      ROW FORMAT SERDE 'myserde'
      STORED AS INPUTFORMAT 'myinputformat' OUTPUTFORMAT 'myoutputformat'
      LOCATION '/x/y/x';

      Seem like Hue uses the base location for the table and then assumes that the folders storing the partitions will be named using the convention part_col=nnnn which might be common but not mandatory.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jennykim Jenny Kim
                Reporter:
                pettax Petter von Dolwitz
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: