Uploaded image for project: 'Livy (READ-ONLY)'
  1. Livy (READ-ONLY)
  2. LIVY-229

Spark version check fails when it's used with HDP built Spark

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.3
    • Fix Version/s: 0.3
    • Component/s: Server
    • Labels:
      None

      Description

      Spark version check fails when it's used with HDP built Spark.

      Exception in thread "main" java.lang.IllegalArgumentException: Fail to parse Spark version from 2.0.0.2.5.1.0-56.
      

      As 2.0.0.2.5.1.0-56 doesn't match regex

        def formatSparkVersion(version: String): (Int, Int) = {
          val versionPattern = """(\d)+\.(\d)+(?:\.\d*)?""".r
      

        Attachments

          Activity

            People

            • Assignee:
              tc0312 Alex Man
              Reporter:
              tc0312 Alex Man
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: