Details
-
Type:
Sub-task
-
Status: Closed
-
Priority:
Major
-
Resolution: Incomplete
-
Affects Version/s: 3.9.0
-
Fix Version/s: None
-
Component/s: app.jobbrowser
-
Labels:None
Description
Job browser test is failing to kill jobs for some reason with the following error:
====================================================================== FAIL: test_failed_jobs (jobbrowser.tests.TestJobBrowserWithHadoop) Test jobs with genuine failure, not just killed ---------------------------------------------------------------------- Traceback (most recent call last): File "/var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/jobbrowser/src/jobbrowser/tests.py", line 227, in test_failed_jobs assert_true(hadoop_job_id_short in response.content) AssertionError: False is not true -------------------- >> begin captured logging << -------------------- requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue_jobbrowser_test?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test?permission=0755&op=MKDIRS&user.name=hue&doas=hdfs HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test?permission=0755&op=SETPERMISSION&user.name=hue&doas=hdfs HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test?owner=hue_jobbrowser_test&op=SETOWNER&group=hue_jobbrowser_test&user.name=hue&doas=hdfs HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: desktop.middleware: INFO: Unloading AuditLoggingMiddleware desktop.middleware: INFO: Unloading SpnegoMiddleware desktop.middleware: INFO: Unloading HueRemoteUserMiddleware access: INFO: 127.0.0.1 hue_jobbrowser_test - "POST /oozie/install_examples/ HTTP/1.1" requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1?op=GETHOMEDIRECTORY&user.name=hue&doas=sample HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"Path":"/user/sample"} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/sample?op=GETFILESTATUS&user.name=hue&doas=sample HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... oozie.management.commands.oozie_setup: INFO: Creating sample directory '/user/hue/oozie/workspaces' in HDFS requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/bundles to /user/hue/oozie/workspaces/bundles requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/bundles?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/bundles/copy-files?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/bundles/copy-files/empty?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/bundles/copy-files/empty already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/bundles/aggregate?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/bundles/aggregate/bundle.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/bundles/aggregate/bundle.zip already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/unmanaged to /user/hue/oozie/workspaces/unmanaged requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/shell?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/shell/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/shell/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/shell/hello.py?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/shell/hello.py already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/fs?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/fs/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/fs/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/pig?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/pig/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/pig/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/pig/aggregate.pig?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/pig/aggregate.pig already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sleep?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sleep/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/sleep/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/hive?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/hive/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/hive/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/hive/hive-config.xml?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/hive/hive-config.xml already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/hive/hive.sql?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/hive/hive.sql already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/email?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/email/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/email/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/distcp?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/distcp/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/distcp/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/ssh?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/ssh/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/ssh/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sqoop?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sqoop/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/sqoop/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sqoop/TT.java?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/sqoop/TT.java already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sqoop/db.hsqldb.script?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/sqoop/db.hsqldb.script already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/unmanaged/sqoop/db.hsqldb.properties?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/unmanaged/sqoop/db.hsqldb.properties already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/managed to /user/hue/oozie/workspaces/managed requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/sleepfork?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sleepfork/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sleepfork/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/generic?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/generic/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/generic/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/terasort?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/terasort/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/terasort/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/shell?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/shell/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/shell/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/shell/hello.py?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/shell/hello.py already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/fs?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/fs/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/fs/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/fs/workflow?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/fs/workflow/workflow.xml?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/fs/workflow/workflow.xml already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/fs/workflow/workflow-metadata.json?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/fs/workflow/workflow-metadata.json already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/pig?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/pig/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/pig/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/pig/aggregate.pig?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/pig/aggregate.pig already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/sleep?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sleep/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sleep/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/hive?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/hive/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/hive/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/hive/hive-config.xml?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/hive/hive-config.xml already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/hive/hive.sql?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/hive/hive.sql already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/email?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/email/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/email/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/distcp?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/distcp/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/distcp/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/ssh?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/ssh/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/ssh/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/managed/sqoop?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sqoop/workflow.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sqoop/workflow.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sqoop/TT.java?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sqoop/TT.java already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sqoop/db.hsqldb.script?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sqoop/db.hsqldb.script already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/managed/sqoop/db.hsqldb.properties?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/managed/sqoop/db.hsqldb.properties already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/coordinators to /user/hue/oozie/workspaces/coordinators requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/coordinators?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/coordinators/dailyanalytics?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/coordinators/dailyanalytics/coordinator.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/coordinators/dailyanalytics/coordinator.zip already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/coordinators/daily-copy?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/coordinators/daily-copy/empty?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/coordinators/daily-copy/empty already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/coordinators/dailysleep?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/coordinators/dailysleep/coordinator.zip?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/coordinators/dailysleep/coordinator.zip already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/lib to /user/hue/oozie/workspaces/lib requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/lib?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/lib/hadoop-examples.jar already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying examples /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/oozie/src/oozie/../../examples/workflows to /user/hue/oozie/workspaces/workflows requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/hiveserver2?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/workflows/hiveserver2/select.sql?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/workflows/hiveserver2/select.sql already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/sleep?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/sleep/dir?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/workflows/sleep/dir/empty?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/workflows/sleep/dir/empty already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/workflows/sleep/empty?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/workflows/sleep/empty already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/fork?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/workflows/fork/dump.pig?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/workflows/fork/dump.pig already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/spark-scala?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/workflows/spark-scala/lib?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/workflows/spark-scala/lib/oozie-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/workflows/spark-scala/lib/oozie-examples.jar already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Copying data /var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/ext/thirdparty/sample_data to /user/hue/oozie/workspaces/data requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data/20130604?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130604/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130604/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130604/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130604/midsummer.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data/20130601?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130601/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130601/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130601/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130601/midsummer.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data/20130603?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130603/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130603/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130603/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130603/midsummer.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data/20130602?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130602/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130602/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130602/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130602/midsummer.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/midsummer.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/data/20130605?permission=0755&op=MKDIRS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130605/sonnets.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130605/sonnets.txt already exists. Skipping. requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/data/20130605/midsummer.txt?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1437... hadoop.fs.hadoopfs: INFO: /user/hue/oozie/workspaces/data/20130605/midsummer.txt already exists. Skipping. oozie.management.commands.oozie_setup: INFO: Installing examples... oozie.management.commands.oozie_setup: INFO: Installing workflow Shell oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Shell" xmlns="uri:oozie:workflow:0.4"> <start to="Shell"/> <action name="Shell"> <shell xmlns="uri:oozie:shell-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <exec>hello.py</exec> <argument>World!</argument> <file>hello.py#hello.py</file> <capture-output/> </shell> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Shell oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Shell WORKFLOW NAME: Shell oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Shell oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Shell oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Shell oozie.management.commands.oozie_setup: INFO: Installing workflow Fs oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Fs" xmlns="uri:oozie:workflow:0.4"> <start to="Fs"/> <action name="Fs"> <fs> <delete path='${nameNode}${output}/testfs'/> <mkdir path='${nameNode}${output}/testfs'/> <mkdir path='${nameNode}${output}/testfs/source'/> <move source='${nameNode}${output}/testfs/source' target='${nameNode}${output}/testfs/renamed'/> <chmod path='${nameNode}${output}/testfs/renamed' permissions='700' dir-files='false'/> <touchz path='${nameNode}${output}/testfs/new_file'/> </fs> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Fs oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Fs WORKFLOW NAME: Fs oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Fs oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Fs oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Fs oozie.management.commands.oozie_setup: INFO: Installing workflow Pig oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Pig" xmlns="uri:oozie:workflow:0.4"> <start to="Pig"/> <action name="Pig"> <pig> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <prepare> <delete path="${nameNode}${output}"/> </prepare> <script>aggregate.pig</script> <argument>-param</argument> <argument>INPUT=${input}</argument> <argument>-param</argument> <argument>OUTPUT=${output}</argument> </pig> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Pig oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Pig WORKFLOW NAME: Pig oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Pig oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Pig oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Pig oozie.management.commands.oozie_setup: INFO: Installing workflow MapReduce oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="MapReduce" xmlns="uri:oozie:workflow:0.4"> <start to="Sleep"/> <action name="Sleep"> <map-reduce> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>mapred.reduce.tasks</name> <value>1</value> </property> <property> <name>mapred.mapper.class</name> <value>org.apache.hadoop.examples.SleepJob</value> </property> <property> <name>mapred.reducer.class</name> <value>org.apache.hadoop.examples.SleepJob</value> </property> <property> <name>mapred.mapoutput.key.class</name> <value>org.apache.hadoop.io.IntWritable</value> </property> <property> <name>mapred.mapoutput.value.class</name> <value>org.apache.hadoop.io.NullWritable</value> </property> <property> <name>mapred.output.format.class</name> <value>org.apache.hadoop.mapred.lib.NullOutputFormat</value> </property> <property> <name>mapred.input.format.class</name> <value>org.apache.hadoop.examples.SleepJob$SleepInputFormat</value> </property> <property> <name>mapred.partitioner.class</name> <value>org.apache.hadoop.examples.SleepJob</value> </property> <property> <name>mapred.speculative.execution</name> <value>false</value> </property> <property> <name>sleep.job.map.sleep.time</name> <value>0</value> </property> <property> <name>sleep.job.reduce.sleep.time</name> <value>${REDUCER_SLEEP_TIME}</value> </property> </configuration> </map-reduce> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: MapReduce oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Sleep WORKFLOW NAME: MapReduce oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: MapReduce oozie.importlib.workflows: DEBUG: Finished resolving links for workflow MapReduce oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow MapReduce oozie.management.commands.oozie_setup: INFO: Installing workflow Hive oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Hive" xmlns="uri:oozie:workflow:0.4"> <start to="Hive"/> <action name="Hive"> <hive xmlns="uri:oozie:hive-action:0.2"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <job-xml>hive-config.xml</job-xml> <script>hive.sql</script> <file>hive-config.xml#hive-config.xml</file> </hive> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Hive oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Hive WORKFLOW NAME: Hive oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Hive oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Hive oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Hive oozie.management.commands.oozie_setup: INFO: Installing workflow Email oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Email" xmlns="uri:oozie:workflow:0.4"> <start to="Email"/> <action name="Email"> <email xmlns="uri:oozie:email-action:0.1"> <to>example@example.org</to> <subject>I love</subject> <body>Hue</body> </email> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Email oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Email WORKFLOW NAME: Email oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Email oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Email oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Email oozie.management.commands.oozie_setup: INFO: Installing workflow DistCp oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="DistCp" xmlns="uri:oozie:workflow:0.4"> <start to="DistCp"/> <action name="DistCp"> <distcp xmlns="uri:oozie:distcp-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <arg>-overwrite</arg> <arg>-m</arg> <arg>${MAP_NUMBER}</arg> <arg>/user/hue/oozie/workspaces/data</arg> <arg>${OUTPUT}</arg> </distcp> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: DistCp oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: DistCp WORKFLOW NAME: DistCp oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: DistCp oozie.importlib.workflows: DEBUG: Finished resolving links for workflow DistCp oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow DistCp oozie.management.commands.oozie_setup: INFO: Installing workflow Ssh oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Ssh" xmlns="uri:oozie:workflow:0.4"> <start to="Ssh"/> <action name="Ssh"> <ssh xmlns="uri:oozie:ssh-action:0.1"> <host>${user}@${host}</host> <command>ls</command> <args>-l</args> <capture-output/> </ssh> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Ssh oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Ssh WORKFLOW NAME: Ssh oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Ssh oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Ssh oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Ssh oozie.management.commands.oozie_setup: INFO: Installing workflow Sqoop oozie.management.commands.oozie_setup: DEBUG: Workflow definition: <workflow-app name="Sqoop" xmlns="uri:oozie:workflow:0.4"> <start to="Sqoop"/> <action name="Sqoop"> <sqoop xmlns="uri:oozie:sqoop-action:0.2"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <prepare> <delete path="${nameNode}${output}"/> </prepare> <command>import --connect jdbc:hsqldb:file:db.hsqldb --table TT --target-dir ${output} -m 1</command> <file>db.hsqldb.properties#db.hsqldb.properties</file> <file>db.hsqldb.script#db.hsqldb.script</file> </sqoop> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: Sqoop oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: Sqoop WORKFLOW NAME: Sqoop oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: Sqoop oozie.importlib.workflows: DEBUG: Finished resolving links for workflow Sqoop oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow Sqoop desktop.models: INFO: Looking for documents that have no object requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue_jobbrowser_test?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue_jobbrowser_test?op=GETFILESTATUS&user.name=hue&doas=hdfs HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue_jobbrowser_test?op=LISTSTATUS&user.name=hue&doas=hdfs HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatuses":{"FileStatus":[ ... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test?permission=0777&op=SETPERMISSION&user.name=hue&doas=hdfs HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: access: INFO: 127.0.0.1 hue_jobbrowser_test - "POST /jobsub/designs/mapreduce/new HTTP/1.1" requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?permission=0755&op=MKDIRS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?permission=0755&op=SETPERMISSION&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: access: INFO: 127.0.0.1 hue_jobbrowser_test - "POST /oozie/submit_workflow/18 HTTP/1.1" liboozie.submittion: INFO: Using FS WebHdfs at http://erickt-2.vpc.cloudera.com:20101/webhdfs/v1 and JT None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81?permission=0711&op=SETPERMISSION&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/workflow.xml?permission=0644&op=CREATE&user.name=hue&overwrite=true&doas=hue_jobbrowser_test HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/workflow.xml?op=CREATE&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&overwrite=true&permission=644 HTTP/1.1" 201 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: liboozie.submittion: DEBUG: Created /user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/workflow.xml liboozie.submittion: DEBUG: Updating /user/hue/oozie/workspaces/lib/hadoop-examples.jar requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1438... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?length=67108864&op=OPEN&user.name=hue&offset=0&doas=hue_jobbrowser_test HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?op=OPEN&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&length=67108864&offset=0 HTTP/1.1" 200 142551 hadoop.fs.webhdfs: DEBUG: GET Got response: PK �����N?������������ ��ME... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/lib/hadoop-examples.jar?permission=0755&blocksize=134217728&doas=hue_jobbrowser_test&replication=1&user.name=hue&overwrite=true&op=CREATE HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-18-1439312435.81/lib/hadoop-examples.jar?op=CREATE&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&blocksize=134217728&overwrite=true&permission=755&replication=1 HTTP/1.1" 201 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: liboozie.submittion: INFO: Using FS WebHdfs at http://erickt-2.vpc.cloudera.com:20101/webhdfs/v1 and JT None requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "POST /oozie/v1/jobs?timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 201 45 liboozie.oozie_api: DEBUG: POST Got response: {"id":"0000037-150803112833837-o... liboozie.submittion: INFO: Submitted: Submission for job '0000037-150803112833837-oozie-oozi-W'. -- 0000037-150803112833837-oozie-oozi-W requests.packages.urllib3.connectionpool: DEBUG: "PUT /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?action=start&timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 0 liboozie.oozie_api: DEBUG: PUT Got response: liboozie.submittion: INFO: Started: Submission for job '0000037-150803112833837-oozie-oozi-W'. -- 0000037-150803112833837-oozie-oozi-W access: INFO: 127.0.0.1 hue_jobbrowser_test - "GET /oozie/list_oozie_workflow/0000037-150803112833837-oozie-oozi-W/ HTTP/1.1" requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 4272 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&show=definition&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 2551 liboozie.oozie_api: DEBUG: GET Got response: <workflow-app name="hue_jobbrow... oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: hue_jobbrowser_test_sleep_job WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Finished resolving links for workflow oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4272 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: Checking status of 0000037-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4461 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312442] Status after 5: 0000037-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000037-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4461 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312447] Status after 10: 0000037-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000037-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4461 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312452] Status after 15: 0000037-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000037-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 5162 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312457] Status after 20: 0000037-150803112833837-oozie-oozi-W - KILLED requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&show=log&user.name=hue&doAs=hdfs HTTP/1.1" 200 None liboozie.oozie_api: DEBUG: GET Got response: 2015-08-11 10:00:36,404 INFO org... liboozie.oozie_api_tests: INFO: [1439312457] Job 0000037-150803112833837-oozie-oozi-W took 20: 2015-08-11 10:00:36,404 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@:start:] Start action [0000037-150803112833837-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:00:36,408 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@:start:] [***0000037-150803112833837-oozie-oozi-W@:start:***]Action status=DONE 2015-08-11 10:00:36,408 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@:start:] [***0000037-150803112833837-oozie-oozi-W@:start:***]Action updated in DB! 2015-08-11 10:00:36,509 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] Start action [0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:00:37,190 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] checking action, hadoop job ID [job_1438626435398_0130] status [RUNNING] 2015-08-11 10:00:37,192 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] [***0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job***]Action status=RUNNING 2015-08-11 10:00:37,192 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] [***0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job***]Action updated in DB! 2015-08-11 10:00:54,118 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[erickt-2.vpc.cloudera.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] callback for action [0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] 2015-08-11 10:00:54,285 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] action completed, external ID [job_1438626435398_0130] 2015-08-11 10:00:54,296 WARN org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.MapReduceMain], main() threw exception, Could not find Yarn tags property (mapreduce.job.tags) 2015-08-11 10:00:54,296 WARN org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] Launcher exception: Could not find Yarn tags property (mapreduce.job.tags) java.lang.RuntimeException: Could not find Yarn tags property (mapreduce.job.tags) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:53) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getYarnJobForMapReduceAction(LauncherMainHadoopUtils.java:75) at org.apache.oozie.action.hadoop.MapReduceMain.run(MapReduceMain.java:58) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:46) at org.apache.oozie.action.hadoop.MapReduceMain.main(MapReduceMain.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 2015-08-11 10:00:54,355 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@hue_jobbrowser_test_sleep_job] ERROR is considered as FAILED for SLA 2015-08-11 10:00:54,400 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@kill] Start action [0000037-150803112833837-oozie-oozi-W@kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:00:54,404 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@kill] [***0000037-150803112833837-oozie-oozi-W@kill***]Action status=DONE 2015-08-11 10:00:54,404 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_sleep_job] JOB[0000037-150803112833837-oozie-oozi-W] ACTION[0000037-150803112833837-oozie-oozi-W@kill] [***0000037-150803112833837-oozie-oozi-W@kill***]Action updated in DB! requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000037-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 5162 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test/jt-test_failed_jobs?permission=0755&op=MKDIRS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue_jobbrowser_test/input?permission=0755&op=MKDIRS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue_jobbrowser_test/output?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None jobbrowser.tests: ERROR: failed to teardown tests Traceback (most recent call last): File "/var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/apps/jobbrowser/src/jobbrowser/tests.py", line 183, in test_failed_jobs TestJobBrowserWithHadoop.cluster.fs.rmtree(OUTPUT_DIR) File "/var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 323, in rmtree self._trash(path, recursive=True) File "/var/lib/jenkins/workspace/Hue-Systest-Create-And-Run/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 272, in _trash raise IOError(errno.ENOENT, _("File %s not found") % path) IOError: [Errno 2] File /user/hue_jobbrowser_test/output not found access: INFO: 127.0.0.1 hue_jobbrowser_test - "POST /jobsub/designs/mapreduce/new HTTP/1.1" requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?permission=0755&op=MKDIRS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: PUT Got response: {"boolean":true} requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?permission=0755&op=SETPERMISSION&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: access: INFO: 127.0.0.1 hue_jobbrowser_test - "POST /oozie/submit_workflow/20 HTTP/1.1" liboozie.submittion: INFO: Using FS WebHdfs at http://erickt-2.vpc.cloudera.com:20101/webhdfs/v1 and JT None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/deployments/_%24USER_-oozie-%24JOBID-%24TIME?op=GETFILESTATUS&user.name=hue&doas=hue HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":0,"b... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26?permission=0711&op=SETPERMISSION&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/workflow.xml?permission=0644&op=CREATE&user.name=hue&overwrite=true&doas=hue_jobbrowser_test HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/workflow.xml?op=CREATE&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&overwrite=true&permission=644 HTTP/1.1" 201 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: liboozie.submittion: DEBUG: Created /user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/workflow.xml liboozie.submittion: DEBUG: Updating /user/hue/oozie/workspaces/lib/hadoop-examples.jar requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 200 None hadoop.fs.webhdfs: DEBUG: GET Got response: {"FileStatus":{"accessTime":1439... requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/lib/hadoop-examples.jar?op=GETFILESTATUS&user.name=hue&doas=hue_jobbrowser_test HTTP/1.1" 404 None requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?length=67108864&op=OPEN&user.name=hue&offset=0&doas=hue_jobbrowser_test HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "GET /webhdfs/v1/user/hue/oozie/workspaces/lib/hadoop-examples.jar?op=OPEN&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&length=67108864&offset=0 HTTP/1.1" 200 142551 hadoop.fs.webhdfs: DEBUG: GET Got response: PK �����N?������������ ��ME... requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/lib/hadoop-examples.jar?permission=0755&blocksize=134217728&doas=hue_jobbrowser_test&replication=1&user.name=hue&overwrite=true&op=CREATE HTTP/1.1" 307 0 requests.packages.urllib3.connectionpool: DEBUG: "PUT /webhdfs/v1/user/hue/oozie/workspaces/_hue_jobbrowser_test_-oozie-20-1439312462.26/lib/hadoop-examples.jar?op=CREATE&doas=hue_jobbrowser_test&user.name=hue&namenoderpcaddress=erickt-2.vpc.cloudera.com:8020&blocksize=134217728&overwrite=true&permission=755&replication=1 HTTP/1.1" 201 0 hadoop.fs.webhdfs: DEBUG: PUT Got response: liboozie.submittion: INFO: Using FS WebHdfs at http://erickt-2.vpc.cloudera.com:20101/webhdfs/v1 and JT None requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "POST /oozie/v1/jobs?timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 201 45 liboozie.oozie_api: DEBUG: POST Got response: {"id":"0000038-150803112833837-o... liboozie.submittion: INFO: Submitted: Submission for job '0000038-150803112833837-oozie-oozi-W'. -- 0000038-150803112833837-oozie-oozi-W requests.packages.urllib3.connectionpool: DEBUG: "PUT /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?action=start&timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 0 liboozie.oozie_api: DEBUG: PUT Got response: liboozie.submittion: INFO: Started: Submission for job '0000038-150803112833837-oozie-oozi-W'. -- 0000038-150803112833837-oozie-oozi-W access: INFO: 127.0.0.1 hue_jobbrowser_test - "GET /oozie/list_oozie_workflow/0000038-150803112833837-oozie-oozi-W/ HTTP/1.1" requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 3486 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&show=definition&user.name=hue&doAs=hue_jobbrowser_test HTTP/1.1" 200 1519 liboozie.oozie_api: DEBUG: GET Got response: <workflow-app name="hue_jobbrow... oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: start LINK NAME: start WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: action LINK NAME: hue_jobbrowser_test_test_failed_jobs-1 WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Getting node with data - XML TAG: end LINK NAME: end WORKFLOW NAME: oozie.importlib.workflows: DEBUG: Finished resolving links for workflow oozie.importlib.workflows: DEBUG: Finished assigning properties to workflow requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 3486 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: Checking status of 0000038-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 3695 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312468] Status after 5: 0000038-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000038-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 3695 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312473] Status after 10: 0000038-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000038-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 3695 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312478] Status after 15: 0000038-150803112833837-oozie-oozi-W - RUNNING liboozie.oozie_api_tests: INFO: Checking status of 0000038-150803112833837-oozie-oozi-W... requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4396 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... liboozie.oozie_api_tests: INFO: [1439312483] Status after 20: 0000038-150803112833837-oozie-oozi-W - KILLED requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&show=log&user.name=hue&doAs=hdfs HTTP/1.1" 200 None liboozie.oozie_api: DEBUG: GET Got response: 2015-08-11 10:01:02,754 INFO org... liboozie.oozie_api_tests: INFO: [1439312483] Job 0000038-150803112833837-oozie-oozi-W took 20: 2015-08-11 10:01:02,754 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@:start:] Start action [0000038-150803112833837-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:01:02,758 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@:start:] [***0000038-150803112833837-oozie-oozi-W@:start:***]Action status=DONE 2015-08-11 10:01:02,758 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@:start:] [***0000038-150803112833837-oozie-oozi-W@:start:***]Action updated in DB! 2015-08-11 10:01:02,849 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] Start action [0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:01:03,533 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] checking action, hadoop job ID [job_1438626435398_0131] status [RUNNING] 2015-08-11 10:01:03,535 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] [***0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1***]Action status=RUNNING 2015-08-11 10:01:03,535 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] [***0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1***]Action updated in DB! 2015-08-11 10:01:19,757 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[erickt-2.vpc.cloudera.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] callback for action [0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] 2015-08-11 10:01:19,940 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] action completed, external ID [job_1438626435398_0131] 2015-08-11 10:01:19,949 WARN org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.MapReduceMain], main() threw exception, Could not find Yarn tags property (mapreduce.job.tags) 2015-08-11 10:01:19,949 WARN org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] Launcher exception: Could not find Yarn tags property (mapreduce.job.tags) java.lang.RuntimeException: Could not find Yarn tags property (mapreduce.job.tags) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:53) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getYarnJobForMapReduceAction(LauncherMainHadoopUtils.java:75) at org.apache.oozie.action.hadoop.MapReduceMain.run(MapReduceMain.java:58) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:46) at org.apache.oozie.action.hadoop.MapReduceMain.main(MapReduceMain.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 2015-08-11 10:01:20,010 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@hue_jobbrowser_test_test_failed_jobs-1] ERROR is considered as FAILED for SLA 2015-08-11 10:01:20,056 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@kill] Start action [0000038-150803112833837-oozie-oozi-W@kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2015-08-11 10:01:20,061 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@kill] [***0000038-150803112833837-oozie-oozi-W@kill***]Action status=DONE 2015-08-11 10:01:20,061 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[erickt-2.vpc.cloudera.com] USER[hue_jobbrowser_test] GROUP[-] TOKEN[] APP[hue_jobbrowser_test_test_failed_jobs-1] JOB[0000038-150803112833837-oozie-oozi-W] ACTION[0000038-150803112833837-oozie-oozi-W@kill] [***0000038-150803112833837-oozie-oozi-W@kill***]Action updated in DB! requests.packages.urllib3.connectionpool: DEBUG: "GET /oozie/v1/job/0000038-150803112833837-oozie-oozi-W?timezone=America%2FLos_Angeles&user.name=hue&doAs=hdfs HTTP/1.1" 200 4396 liboozie.oozie_api: DEBUG: GET Got response: {"appPath":"hdfs:\/\/erickt-2.vp... access: INFO: 127.0.0.1 hue_jobbrowser_test - "GET /jobbrowser/jobs/ HTTP/1.1" requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: erickt-2.vpc.cloudera.com requests.packages.urllib3.connectionpool: DEBUG: "GET /ws/v1/cluster/apps?limit=10000&user=hue_jobbrowser_test&finalStatus=KILLED HTTP/1.1" 200 None hadoop.yarn.resource_manager_api: DEBUG: GET Got response: {"apps":null} access: INFO: 127.0.0.1 hue_jobbrowser_test - "GET /jobbrowser/jobs/ HTTP/1.1" requests.packages.urllib3.connectionpool: DEBUG: "GET /ws/v1/cluster/apps?limit=10000&user=hue_jobbrowser_test&finalStatus=FAILED HTTP/1.1" 200 None hadoop.yarn.resource_manager_api: DEBUG: GET Got response: {"apps":null} --------------------- >> end captured logging << ---------------------