Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-41

Use date partitioning in the end-to-end demo

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.4.0
    • Component/s: Data Module, Examples
    • Labels:
      None

      Description

      The flow is:

      • Flume logging writes to partitioned directories (/year=Y/month=M/day=D)
      • Oozie detects new partitions and runs a Crunch job to transform the event data into partitioned session data.
      • Hive queries the partitioned session data.

      Work to support these features will be added in sub-tasks.

        Attachments

          Activity

            People

            • Assignee:
              tom Tom White
              Reporter:
              tom Tom White
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: