Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-3093

Ability to create SQL Kind Session on Livy Job Server

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Critical
    • Resolution: Incomplete
    • Affects Version/s: 3.9.0
    • Fix Version/s: None
    • Component/s: con.spark

      Description

      Currently Livy Job Server supports only PySpark and Scala Spark kind sessions to create and submit codes.

      curl -X POST --data '

      {"kind": "pyspark"}

      ' -H "Content-Type: application/json" localhost:8998/sessions
      curl -X POST --data '

      {"kind": "spark"}

      ' -H "Content-Type: application/json" localhost:8998/sessions

      It would be better, if we are able to create '

      {"kind": "sql"}

      ' kind session to submit spark sql through hiveContext.

      eg:
      curl -X POST --data '

      {"kind": "sql"}

      ' -H "Content-Type: application/json" localhost:8998/sessions
      curl localhost:8998/sessions/0/statements -X POST -H 'Content-Type: application/json' -d '

      {"code":"INSERT OVERWRITE TABLE target SELECT cols FROM source"}

      '

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              prabhu1984 Prabhu Kasinathan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: