Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2180 [oozie] Editor revamp
  3. HUE-2311

[oozie] Inform user from cause of workflow submission failure

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.6.0
    • Fix Version/s: 3.10.0
    • Component/s: con.oozie
    • Labels:
      None

      Description

      When submitting an invalid WF in Oozie instead of generic "Server Error 500" would be nice feature to prompt with the "middle2are" error

      For example using the Hue demo "MapReduce" Sleep WF

      Edit the WF and instead of using the "/user/hue/oozie/workspaces/lib/hadoop-examples.jar" type in an invalid .jar "/user/hue/oozie/workspaces/lib/hadoop-examplesx.jar"

      This produces

      [03/Sep/2014 03:25:35 -0700] base         ERROR    Internal Server Error: /oozie/submit_workflow/25
      Traceback (most recent call last):
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py", line 111, in get_response
          response = callback(request, *callback_args, **callback_kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
          return view_func(request, *args, **kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/views/editor.py", line 338, in submit_workflow
          job_id = _submit_workflow(request.user, request.fs, request.jt, workflow, mapping)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/views/editor.py", line 359, in _submit_workflow
          job_id = submission.run()
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 80, in run
          deployment_dir = self.deploy()
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 145, in deploy
          self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 283, in _do_as
          return fn(*args, **kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 277, in _copy_files
          self.fs.copyfile(jar_file, jar_lib_path)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 480, in copyfile
          raise IOError(errno.ENOENT, _("Copy src '%s' does not exist") % src)
      IOError: [Errno 2] Copy src '/user/hue/oozie/workspaces/lib/hadoop-examplesx.jar' does not exist
      [03/Sep/2014 03:25:35 -0700] middleware   INFO     Processing exception: [Errno 2] Copy src '/user/hue/oozie/workspaces/lib/hadoop-examplesx.jar' does not exist: Traceback (most recent call last):
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py", line 111, in get_response
          response = callback(request, *callback_args, **callback_kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
          return view_func(request, *args, **kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/views/editor.py", line 338, in submit_workflow
          job_id = _submit_workflow(request.user, request.fs, request.jt, workflow, mapping)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/apps/oozie/src/oozie/views/editor.py", line 359, in _submit_workflow
          job_id = submission.run()
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 80, in run
          deployment_dir = self.deploy()
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 145, in deploy
          self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 283, in _do_as
          return fn(*args, **kwargs)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 277, in _copy_files
          self.fs.copyfile(jar_file, jar_lib_path)
        File "/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 480, in copyfile
          raise IOError(errno.ENOENT, _("Copy src '%s' does not exist") % src)
      IOError: [Errno 2] Copy src '/user/hue/oozie/workspaces/lib/hadoop-examplesx.jar' does not exist
      
      

        Attachments

          Activity

            People

            • Assignee:
              romain Romain Rigaux
              Reporter:
              michalis Michalis Kongtongk
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: