Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2886

[spark] Show livy session process logs

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.9.0
    • Fix Version/s: 3.10.0
    • Component/s: con.spark
    • Labels:
      None

      Description

      Livy exposes the session log file through a url like /sessions/0/log. This could be shown to the user to better report errors like:

      curl localhost:8998/sessions/0 | python -m json.tool
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                       Dload  Upload   Total   Spent    Left  Speed
      100   196    0   196    0     0  13927      0 --:--:-- --:--:-- --:--:-- 14000
      {
          "id": 0,
          "kind": "spark",
          "log": [
              "Invalid initial heap size: -Xms1mb",
              "Error: Could not create the Java Virtual Machine.",
              "Error: A fatal exception has occurred. Program will exit."
          ],
          "state": "error"
      }
      

        Attachments

          Activity

            People

            • Assignee:
              jennykim Jenny Kim
              Reporter:
              erickt Erick Tryzelaar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: