Uploaded image for project: 'Livy (READ-ONLY)'
  1. Livy (READ-ONLY)
  2. LIVY-159

Support selecting python 2 or 3 for pyspark batch

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Minor
          • Resolution: Fixed
          • Affects Version/s: 0.2
          • Fix Version/s: None
          • Component/s: Batch
          • Labels:
            None

            Description

            currently pyspark working with only python2.
            (fake_shell.py don't work on python3)

            Might need a support both python version.

            how about this.
            AS-IS

            kind = [pyspark, spark, sparkr]

            AS-IS

            # if user choice pyspark3,  PythonInterperter run fake_shell3.py
kind = [pyspark, spark, sparkr, pyspark3]

            If i misunderstood, this ticket close please.

              Attachments

              1. runlogfull.txt
                281 kB
                Kevin Grealish
              2. runloginteresting.txt
                4 kB
                Kevin Grealish

                Issue Links

                related to

                Improvement - An improvement or enhancement to an existing feature or task. LIVY-85 support pyspark with python3

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      KevinGre Kevin Grealish
                    • Votes:
                      1 Vote for this issue
                      Watchers:
                      5 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: