Details

    • Type: Epic
    • Status: Closed
    • Priority: Critical
    • Resolution: Incomplete
    • Affects Version/s: 3.9.0
    • Fix Version/s: 4.9.0
    • Component/s: app.editor
    • Labels:
      None
    • Epic Name:
      Integrated scheduling
    • Target Version:

      Description

      Goal: provide an easy/intuitive way to schedule repetitive queries directly via the Editor.

      Tasks

      1. Schedule a new query
      2. Update a schedule
      3. List scheduled queries

      Engine agnostic

      1. Hive 4
      2. Apache Oozie
      3. Celery Beat
      4. Apache Airflow

      Status

      Currently work in progress with focus on Hive 4 and Celery Beat.

      [notebook]
      enable_query_scheduling=true 

       

      Notes

      About Apache Hive scheduling:

       https://cwiki.apache.org/confluence/display/Hive/Scheduled+Queries

       * create
       create scheduled query Q1 executed as joe scheduled '1 1 * * *’ as update t set a=1;
       * change schedule
       alter scheduled query Q1 cron '2 2 * * *'
       * change query
       alter scheduled query Q1 defined as select 2
       * disable
       alter scheduled query Q1 set disabled
       * enable
       alter scheduled query Q1 set enabled
       * list status
       select * from sysdb.scheduled_queries;
       * drop
       drop scheduled query Q1
       
      		"hive.scheduled.queries.executor.enabled":             "false"
      		"hive.scheduled.queries.namespace":                    ""
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                romain Romain Rigaux
                Reporter:
                romain Romain Rigaux
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: