Details
Description
Submitting a workflow with a java action and relative jar file path always results in a "Server Error (500)" page in Hue.
Inspecting the log shows that Hue is not including the path of the workspace in the webhdfs URL. I have included the relevant entries below. Hue first uses the correct URL to check that the jar file exists (/webhdfs/v1/user/hue/oozie/workspaces/eckertia-oozie-46-1429212710.02/lib/Test1.jar) but then switches to the wrong URL to get the file (/webhdfs/v1/lib/Test1.jar)
Hue Log:
[16/Apr/2015 13:22:37 -0700] middleware INFO Processing exception: [Errno 2] File lib/Test1.jar not found: Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py", line 111, in get_response
response = callback(request, *callback_args, **callback_kwargs)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
return view_func(request, *args, **kwargs)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/views/editor.py", line 338, in submit_workflow
job_id = _submit_workflow(request.user, request.fs, request.jt, workflow, mapping)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/apps/oozie/src/oozie/views/editor.py", line 359, in _submit_workflow
job_id = submission.run()
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 80, in run
deployment_dir = self.deploy()
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 149, in deploy
self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 291, in _do_as
return fn(*args, **kwargs)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 281, in _copy_files
stat_src = self.fs.stats(jar_file)
File "/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.p0.10/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 222, in stats
raise IOError(errno.ENOENT, _("File %s not found") % path)
IOError: [Errno 2] File lib/Test1.jar not found
[16/Apr/2015 13:22:37 -0700] connectionpool DEBUG "GET /webhdfs/v1/lib/Test1.jar?op=GETFILESTATUS&user.name=hue&doas=eckertia HTTP/1.1" 404 None
[16/Apr/2015 13:22:37 -0700] connectionpool DEBUG Setting read timeout to None
[16/Apr/2015 13:22:37 -0700] resource DEBUG GET Got response: {"FileStatus":{"accessTime":1429...
[16/Apr/2015 13:22:37 -0700] connectionpool DEBUG "GET /webhdfs/v1/user/hue/oozie/workspaces/eckertia-oozie-46-1429212710.02/lib/Test1.jar?op=GETFILESTATUS&user.name=hue&doas=eckertia HTTP/1.1" 200 None
[16/Apr/2015 13:22:37 -0700] connectionpool DEBUG Setting read timeout to None
Attachments
Issue Links
- relates to
-
HUE-2092 [liboozie] Jar files not in workspace should not be deleted at submittion
-
- Resolved
-