Details
Description
- Switching to transactional by default only works in Hive 3+ (need ORC)
- LOAD won't work without an upload to HDFS currently (so not even S3)
- Text data files currently ranges from about 50 to 150k
"transactional_properties"="insert_only" --> no DELETE
Either the tables should be external or they should be created with tblproperties ("transactional"="true", "transactional_properties"="insert_only") e.g. create table foo ( x int ) stored as parquet tblproperties ("transactional"="true", "transactional_properties"="insert_only"); insert into table foo2 values(1),(2);