Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.2.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      TestCrunchDatasetsHive hangs in CI all the time, but succeeds locally for me.

      I've tracked this problem back to the execution order of the tests. When the HBase, FileSystem, and then Hive tests are run in that order, Hive hangs indefinitely. I attached a debugger and tried to find the problem, but didn't see a thread running any code. It looks like the map phase never starts. The CrunchControlledJob is its initial state, but claims to have submitted the job.

      There are some HBase-related threads hanging around that are suspect because this happens when HBase runs first, so I tried not reusing the forked surefire VMs and it appears to fix the problem. I'm not sure what the root cause is.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                blue Ryan Blue
                Reporter:
                blue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: