Details
-
Type:
New Feature
-
Status: Resolved
-
Priority:
Critical
-
Resolution: Won't Fix
-
Affects Version/s: 3.9.0
-
Fix Version/s: None
-
Component/s: con.spark
-
Labels:
Description
Currently, we are creating new pyspark session and submitting codes through newly created session id as below
curl -X POST --data '
{"kind": "pyspark", "queue": "spark", "name": "Livy_Example"}' -H "Content-Type: application/json" localhost:8998/sessions
curl localhost:8998/sessions/1/statements -X POST -H 'Content-Type: application/json' -d '
'
But, it would be nice if we have a way to submit the codes through session name instead of session id. That way, we need not to maintain a lookup table for session-id to session-name. Users will be able to submit their codes easily as below through session names instead of worrying about session id.
curl -X POST --data '
{"kind": "pyspark", "queue": "spark", "name": "mkt_risk_batch"}' -H "Content-Type: application/json" localhost:8998/sessions
curl localhost:8998/sessions/mkt_risk_batch/statements -X POST -H 'Content-Type: application/json' -d '
'