Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2526

Deadlock possible if there are too many concurrent hive/impala requests

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.7.0
    • Fix Version/s: 3.8.0
    • Component/s: core.api
    • Labels:
      None

      Description

      Hue can deadlock if there are a number of concurrent requests to impala or hive. This bug is happening inside the thrift_util, where we are somehow consuming all the pooled connections and not returning them back to the pool. I suspect what's happening is one code path is grabbing two connections to do some operation. With a large number of concurrent requests, we can end up with all the threads stuck holding one of the two connections they need.

      There's a pretty simple fix where we grab and release a connection as soon as possible. This has been submitted to https://review.cloudera.org/r/4847/. However, it'd be nice to find and fix that deadlock.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                erickt Erick Tryzelaar
                Reporter:
                erickt Erick Tryzelaar
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: