Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-1007 Optimize Kite Oozie URIHandler
  3. KITE-1010

Add DependencyType.PUSH support to KiteURIHandler for Hive-backed datasets

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This task is to update the KiteURIHandler to support DependencyType.PUSH for Hive-backed datasets similar to HCatURIHandler. Doing so would reduce the polling load put on the NameNode while simultaneously decreasing the latency for firing downstream workflows when an input dataset completes.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ben.roling Ben Roling
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: