Logging is fixed at INFO level in hadoop-daemon.sh instead of using log4j.properties

REOPEN - DISTRO-339

I don't think HADOOP-8008 is a dupe of this report.

The main problem is the fixed "HADOOP_ROOT_LOGGER"-var in hadoop-daemon.sh, so every ENV-var in hadoop-env.sh will be useless/ignored.

This blog entry describes the problem very well.

http://www.paluch.biz/blog/95-logging-hadoop-messages-into-logstash-using-logstash-gelf.html

–

In the file /usr/lib/hadoop/bin/hadoop-daemon.sh the LOGLEVEL is set through an environment variable:
EXPORT HADOOP_ROOT_LOGGER="INFO,DRFA"

Many people expect that changing /usr/lib/hadoop/conf/log4j.properties will change the log level, but it does not. Changing the hadoop-daemon.sh script does the trick, but it is not a clean way. I'm not sure what would be the best way to attack this problem, but it would be nice if we could use log4j.properties.

–