Details
Description
When using pyspark or R interpreter on Hue Spark notebook, Spark notebook could able to connect to Livy-server, but when Scala interpreter is used on Hue spark notebook, notebook is not able to fetch the result data from livy server.
so the sequence happens in this way
connectionpool INFO Starting new HTTP connection (1): localhost
access INFO 10.10.102.89 user- "POST /jobbrowser/jobs/ HTTP/1.1"
access INFO 10.10.102.89 user - "POST /notebook/api/execute HTTP/1.1"
access INFO 10.10.102.89 user - "POST /notebook/api/check_status HTTP/1.1"
So after check_status, spark notebook should able to call fetch_result_data which is not happening. Sometimes it happens and sometimes not so it is very inconsistent