Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-797

Apply patch from YARN-4538 to fix resource reporting

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: CDH 5.4.5
    • Fix Version/s: None
    • Component/s: MapReduce
    • Labels:
      None

      Description

      We'r on CDH 5.4.5 and have encountered this issue with YARN resource reporting. Particularly the issue is in QueueMetrics code that does the pending resource calculation incorrectly. The impact this has is when cluster is busy, YARN reports negative values for pending cores/memory/containers. This also impacts job submissions in clients like Hive that use these metrics to calculate splits.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gkowshik Gautam Kowshik
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: