Details
-
Type: Bug
-
Status: Closed
-
Priority: Minor
-
Resolution: Incomplete
-
Affects Version/s: 3.7.0
-
Fix Version/s: None
-
Component/s: app.catalog
-
Labels:
-
Environment:
CDH 5.4.4 on Ubuntu 14.04
-
Target Version:
Description
Scenario 1 (correct behaviour):
- Create database 'testdb' using the 'Create database' button in the metastore browser
- Database directory on HDFS is created with ownership john:hive drwxrwxrwxt (logged into Hue as john)
- Create table testdb.test_table
- Both 'Drop table' button in metastore browser and executing a DROP TABLE Impala query correctly delete the table files from HDFS
Scenario 2 (expected behaviour):
- Create database 'testdb' by running CREATE DATABASE Impala query
- Database directory on HDFS is created with ownership impala:hive drwxrwxrwxt
- Create table testdb.test_table
- 'Drop table' button in metastore browser removes the table but does not remove the underlying files from HDFS
- Executing a DROP TABLE Impala query does correctly delete the table files from HDFS
Similar behaviour occurs when dropping databases via Hue metastore browser GUI in Scenario 2 (i.e. database directory on HDFS is not removed).
The failure to remove the underlying files means that if a table is subsequently created with the same name, this new table will also contain the old data that was not deleted.