Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2701

[oozie] Java action relative jar path results in error on submit

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.7.0
    • Fix Version/s: 3.9.0
    • Component/s: con.oozie
    • Labels:
      None
    • Environment:

      Cisco Cloud Services

      Description

      Submitting a workflow with a java action and relative jar file path always results in a "Server Error (500)" page in Hue.

      Inspecting the log shows that Hue is not including the path of the workspace in the webhdfs URL. I have included the relevant entries below. Hue first uses the correct URL to check that the jar file exists (/webhdfs/v1/user/hue/oozie/workspaces/eckertia-oozie-46-1429212710.02/lib/Test1.jar) but then switches to the wrong URL to get the file (/webhdfs/v1/lib/Test1.jar)

      Hue Log:

      [16/Apr/2015 13:22:37 -0700] middleware INFO Processing exception: [Errno 2] File lib/Test1.jar not found: Traceback (most recent call last):
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py", line 111, in get_response
      response = callback(request, *callback_args, **callback_kwargs)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
      return view_func(request, *args, **kwargs)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/views/editor.py", line 338, in submit_workflow
      job_id = _submit_workflow(request.user, request.fs, request.jt, workflow, mapping)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/views/editor.py", line 359, in _submit_workflow
      job_id = submission.run()
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 80, in run
      deployment_dir = self.deploy()
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 149, in deploy
      self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 291, in _do_as
      return fn(*args, **kwargs)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 281, in _copy_files
      stat_src = self.fs.stats(jar_file)
      File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 222, in stats
      raise IOError(errno.ENOENT, _("File %s not found") % path)
      IOError: [Errno 2] File lib/Test1.jar not found
      [16/Apr/2015 13:22:37 -0700] connectionpool DEBUG "GET /webhdfs/v1/lib/Test1.jar?op=GETFILESTATUS&user.name=hue&doas=eckertia HTTP/1.1" 404 None
      [16/Apr/2015 13:22:37 -0700] connectionpool DEBUG Setting read timeout to None
      [16/Apr/2015 13:22:37 -0700] resource DEBUG GET Got response: {"FileStatus":{"accessTime":1429...
      [16/Apr/2015 13:22:37 -0700] connectionpool DEBUG "GET /webhdfs/v1/user/hue/oozie/workspaces/eckertia-oozie-46-1429212710.02/lib/Test1.jar?op=GETFILESTATUS&user.name=hue&doas=eckertia HTTP/1.1" 200 None
      [16/Apr/2015 13:22:37 -0700] connectionpool DEBUG Setting read timeout to None

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                romain Romain Rigaux
                Reporter:
                isaac.eckert Isaac Eckert
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: