Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-73

FileSystems leaked when user logs on different FS URI than submit dir

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Blocker
          • Resolution: Fixed
          • Affects Version/s: CDH3b3
          • Fix Version/s: CDH3b4
          • Component/s: None
          • Labels:
            None

            Description

            JobInProgress has a FileSystem member for the submitter UGI on the JT's "submit dir" cluster. In JobHistory.JobInfo.logSubmitted it creates a new FileSystem instance for the output directory's file system (or another FS if the user log location is configured). This might be a different FS instance than the fs member of JobInProgress in which case the LeaseChecker gets leaked, since it won't get closed in JobInProgress.garbageCollect

            I believe this isn't present in trunk due to trunk's inclusion of MAPREDUCE-157

              Attachments

                Activity

                  People

                  • Assignee:
                    todd Todd Lipcon
                    Reporter:
                    todd Todd Lipcon
                  • Votes:
                    1 Vote for this issue
                    Watchers:
                    1 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: