Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-3044

Hue drop table button fails to remove underlying files from HDFS

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Incomplete
    • Affects Version/s: 3.7.0
    • Fix Version/s: None
    • Component/s: app.catalog
    • Environment:

      CDH 5.4.4 on Ubuntu 14.04

      Description

      Scenario 1 (correct behaviour):

      1. Create database 'testdb' using the 'Create database' button in the metastore browser
        1. Database directory on HDFS is created with ownership john:hive drwxrwxrwxt (logged into Hue as john)
      2. Create table testdb.test_table
      3. Both 'Drop table' button in metastore browser and executing a DROP TABLE Impala query correctly delete the table files from HDFS

      Scenario 2 (expected behaviour):

      1. Create database 'testdb' by running CREATE DATABASE Impala query
        1. Database directory on HDFS is created with ownership impala:hive drwxrwxrwxt
      2. Create table testdb.test_table
      3. 'Drop table' button in metastore browser removes the table but does not remove the underlying files from HDFS
      4. Executing a DROP TABLE Impala query does correctly delete the table files from HDFS

      Similar behaviour occurs when dropping databases via Hue metastore browser GUI in Scenario 2 (i.e. database directory on HDFS is not removed).

      The failure to remove the underlying files means that if a table is subsequently created with the same name, this new table will also contain the old data that was not deleted.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              grant.neale@dsto.defence.gov.au Grant Neale
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: