Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-596

Mixed Hive external ownership on CDH 5.1 VM

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 1.1.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      I just ran through one of our workshops on the new 5.1 VM with an external Hive table and noticed that the partitions are owned by both the hive and cloudera users:

      [cloudera@quickstart ~]$ hadoop fs -ls /tmp/data/examples/ratings/year=1997
      Found 4 items
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=09
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=10
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=11
      drwxr-xr-x   - hive     supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12
      [cloudera@quickstart ~]$ hadoop fs -ls /tmp/data/examples/ratings/year=1997/month=12
      Found 29 items
      drwxr-xr-x   - hive     supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12/day=01
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12/day=02
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12/day=03
      drwxr-xr-x   - cloudera supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12/day=04
      drwxr-xr-x   - hive     supergroup          0 2014-08-20 13:49 /tmp/data/examples/ratings/year=1997/month=12/day=05
      

      This was created by the csv-import command with HDFS data, so the import ran as a crunch job.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                joey Joey Echeverria
                Reporter:
                blue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: