Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-6203

[notebook] Not connecting to livy-server 0.3.0 when scala interpreter is used

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 3.11.0
    • Fix Version/s: None
    • Component/s: con.spark
    • Labels:
    • Environment:

      Hive 2.1.1, Pig 0.16.0, Tez 0.8.4, Spark 2.1.0, Hue 3.11.0
      Operating System centOS
      Livy-server 0.3.0

      Description

      When using pyspark or R interpreter on Hue Spark notebook, Spark notebook could able to connect to Livy-server, but when Scala interpreter is used on Hue spark notebook, notebook is not able to fetch the result data from livy server.

      so the sequence happens in this way
      connectionpool INFO Starting new HTTP connection (1): localhost
      access INFO 10.10.102.89 user- "POST /jobbrowser/jobs/ HTTP/1.1"
      access INFO 10.10.102.89 user - "POST /notebook/api/execute HTTP/1.1"
      access INFO 10.10.102.89 user - "POST /notebook/api/check_status HTTP/1.1"

      So after check_status, spark notebook should able to call fetch_result_data which is not happening. Sometimes it happens and sometimes not so it is very inconsistent

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              animesh cyrus
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: