Uploaded image for project: 'Hue'
  1. Hue
  2. HUE-2941

[hadoop] Cache the active RM HA

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.9.0
    • Fix Version/s: 3.10.0
    • Component/s: core.backend
    • Labels:
      None

      Description

      This + potential redirect problem: https://groups.google.com/a/cloudera.org/forum/#!topic/hue-user/oAG1zmsCKWY

      
      [26/Aug/2015 10:43:51 -0700] resource     DEBUG    GET Got response: {"apps":{"app":[{"id":"applicati...
      
      [26/Aug/2015 10:43:51 -0700] kerberos_    DEBUG    handle_response(): returning <Response [200]>
      
      [26/Aug/2015 10:43:51 -0700] kerberos_    DEBUG    handle_mutual_auth(): Handling: 200
      
      [26/Aug/2015 10:43:51 -0700] connectionpool DEBUG    "GET /ws/v1/cluster/apps?limit=10000&user=hive&finalStatus=UNDEFINED HTTP/1.1" 200 None
      
      [26/Aug/2015 10:43:51 -0700] connectionpool INFO     Starting new HTTPS connection (1): nightly-kerberized-3.vpc.cloudera.com
      
      [26/Aug/2015 10:43:51 -0700] cluster      WARNING  Picking RM HA: default
      
      [26/Aug/2015 10:43:51 -0700] resource     DEBUG    GET Got response: {"clusterInfo":{"id":14406105583...
      
      [26/Aug/2015 10:43:51 -0700] kerberos_    DEBUG    handle_response(): returning <Response [200]>
      
      [26/Aug/2015 10:43:51 -0700] kerberos_    DEBUG    handle_mutual_auth(): Handling: 200
      
      [26/Aug/2015 10:43:51 -0700] connectionpool DEBUG    "GET /ws/v1/cluster HTTP/1.1" 200 None
      
      after sopping RM on kerb3
      
      [26/Aug/2015 10:47:59 -0700] resource     DEBUG    GET Got response: {"apps":null}
      
      [26/Aug/2015 10:47:59 -0700] kerberos_    DEBUG    handle_response(): returning <Response [200]>
      
      [26/Aug/2015 10:47:59 -0700] kerberos_    DEBUG    handle_mutual_auth(): Handling: 200
      
      [26/Aug/2015 10:47:59 -0700] connectionpool DEBUG    "GET /ws/v1/cluster/apps?limit=10000&user=hive&finalStatus=UNDEFINED HTTP/1.1" 200 None
      
      [26/Aug/2015 10:47:59 -0700] connectionpool INFO     Starting new HTTPS connection (1): nightly-kerberized-1.vpc.cloudera.com
      
      [26/Aug/2015 10:47:59 -0700] cluster      WARNING  Picking RM HA: ha
      
      [26/Aug/2015 10:47:59 -0700] resource     DEBUG    GET Got response: {"clusterInfo":{"id":14406112160...
      
      [26/Aug/2015 10:47:59 -0700] kerberos_    DEBUG    handle_response(): returning <Response [200]>
      
      [26/Aug/2015 10:47:59 -0700] kerberos_    DEBUG    handle_mutual_auth(): Handling: 200
      
      [26/Aug/2015 10:47:59 -0700] connectionpool DEBUG    "GET /ws/v1/cluster HTTP/1.1" 200 None
      
      [26/Aug/2015 10:47:59 -0700] connectionpool INFO     Starting new HTTPS connection (1): nightly-kerberized-1.vpc.cloudera.com
      
      [26/Aug/2015 10:47:59 -0700] cluster      ERROR    RM default is not available, skipping it: ('Connection aborted.', error(111, 'Connection refused'))
      Traceback (most recent call last):
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/libs/hadoop/src/hadoop/cluster.py", line 191, in get_next_ha_yarncluster
          cluster_info = rm.cluster()
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/resource_manager_api.py", line 86, in cluster
          return self._execute(self._root.get, 'cluster', params=kwargs, headers={'Accept': _JSON_CONTENT_TYPE})
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/resource_manager_api.py", line 98, in _execute
          response = function(*args, **kwargs)
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 97, in get
          return self.invoke("GET", relpath, params, headers=headers, allow_redirects=True)
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 78, in invoke
          urlencode=self._urlencode)
        File "/opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.1007/lib/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 161, in execute
          raise self._exc_class(ex)
      RestException: ('Connection aborted.', error(111, 'Connection refused'))
      
      [26/Aug/2015 10:47:59 -0700] connectionpool INFO     Starting new HTTPS connection (1): nightly-kerberized-3.vpc.cloudera.com
      
      [26/Aug/2015 10:47:59 -0700] cluster      WARNING  Picking RM HA: ha
      
      

        Attachments

          Activity

            People

            • Assignee:
              romain Romain Rigaux
              Reporter:
              romain Romain Rigaux
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: