Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-307

Better oozie coordinator and Hive metastore integration

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Bug
    • Affects Version/s: CDH3u2, CDH3u4
    • Fix Version/s: CDH3u4
    • Component/s: Hadoop Common
    • Labels:
      None

      Description

      One common use case:

      1) Kick off daily sqoop job that retrieves (e.g.) 1 week of data
      2) Drop Hive partitions for the previous 1 week

      ALTER TABLE foo DROP PARTITION (day = 'yyyy-mm-dd') ;

      3) Run Hive job for dynamic partition of the data

      This is currently not supported by Oozie coordinator jobs.

      There are other variations of this use case, but they all involve performing Hive operations across multiple concrete date/time based partitions.

        Attachments

          Activity

            People

            • Assignee:
              eli Eli Collins
              Reporter:
              patrickangeles Patrick Angeles
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: