Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-260

Mapreduce job run from ToolRunner leaks file descriptor

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Works for Me
          • Affects Version/s: CDH3u0
          • Fix Version/s: CDH3u5
          • Component/s: MapReduce
          • Labels:
            None
          • Environment:
            CentOS Linux 2.6.34.7-61.fc13.i686

            Description

            We are running a mapreduce job using ToolRunner in a quartz task in Spring. Each time it runs, it opens 8 file descriptors (seen via lsof | grep hadoop) and closes 2. This leaves 6 open and eventually adds up until the ulimit is reached.

            It may be similar to https://issues.apache.org/jira/browse/HDFS-73.

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    kevin.faro Kevin Faro
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    2 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: