Details
-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.3
-
Fix Version/s: None
-
Component/s: REPL
-
Labels:None
Description
Current Livy support two different scala REPLs, one for Scala-2.10 and another for Scala-2.11, users have to specify which version of Scala they wanted in build time through "-Dscala-2.11" (by default 2.10 is picked), this is not so intuitive. So here propose to ship two repl bundles in one Livy assembly, this requires:
- assembly pom to package two repl folders, one is repl-jars-2.10 and another is repl-jars-2.11.
- Interactive session to upload repl jars according to Scala version of Spark.
- Interactive session to figure out which Scala version Spark uses.
- Spark provides a way to output Scala version (https://issues.apache.org/jira/browse/SPARK-17686).
- Specified by user in creating interactive session.
- Default mapping relation (spark2.0 -> scala-2.11, spark 1.6 -> scala-2.10).
- Changes in integrations test.
This is one step to support different Spark + Scala version in one Livy instance.