Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-901

[beeswax] Process will exit after kill job

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 2.2.0
    • Component/s: con.hive
    • Labels:
    • Environment:

      hive0.7.1 cdh3u4
      hue1.2

      Description

      When a query have more than 1 root stage, kill job with hadoop admin page, beeswax process will exit;
      such this query

      select a.* from (select distinct sn from test) a JOIN (select distinct sn from user) b on (a.sn = b.sn) ;

      I think this is wrong way use hive or hive bug?

      in hive Driver.java, execute()

                } else {
                  // TODO: This error messaging is not very informative. Fix that.
                  errorMessage = "FAILED: Execution Error, return code " + exitVal + " from "
                      + tsk.getClass().getName();
                  SQLState = "08S01";
                  console.printError(errorMessage);
                  if (running.size() != 0) {
                    taskCleanup(); // !!!!!here will call System.exit(9);
                  }
                  return 9;
                }
      
        /**
         * Cleans up remaining tasks in case of failure
         */
      
        public void taskCleanup() {
          // The currently existing Shutdown hooks will be automatically called,
          // killing the map-reduce processes.
          // The non MR processes will be killed as well.
          System.exit(9);
        }
      

      I can simple extend Driver and overide taskCleanup method fix it. But the other map-reduce processes will not be kill.

        Attachments

          Activity

            People

            • Assignee:
              romain Romain Rigaux
              Reporter:
              fatkun fatkun
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: