Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-227

There is no trim() on paths in mapred.local.dir

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: CDH3u0
    • Fix Version/s: CDH3u2
    • Component/s: MapReduce
    • Labels:
      None
    • Environment:
      Ubuntu Linux 10.04

      Description

      This is a bug that I've first seen in CDH3b3.
      The problem is that when naming multiple paths for mapred.local.dir in mapred-site.xml, the whitespace around paths is not trimmed.

      The result is the following error popping up in the jobtracker log file:
      "no valid local directories in property: mapred.local.dir"
      When looking further in the stack trace, I see that in /org/apache/hadoop/conf/Configuration.java the creation of a file named "jobTracker/job_201105......_0001.xml" fails. This is no surprise as the file name that gets passed around contains a newline and whitespace.
      When removing all whitespace and newlines from the config file, everything works as it should.

      I think the method getStringCollection in /org/apache/hadoop/util/StringUtils.java should strip white space to fix this problem.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              eric Eric
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: