How to set DEBUG log level for ResourceManager?

hadoop logging log4j yarn resourcemanager
hakunami picture hakunami · Jan 9, 2015 · Viewed 7.2k times · Source

I am doing some change to Yarn source code. I have changed hadoop.root.logger=DEBUG,console to DEBUG in ${HADOOP_HOME}/etc/hadoop/log4j.properties. I can get DEBUG information for Application Master, but I can't find any DEBUG information outputted in ${HADOOP_HOME}/logs/yarn-yar-resourcemanager-hostname.log. Is there any other place I should change to trigger DEBUG level for resourcemanager?

Answer

Raju Shikha picture Raju Shikha · Jan 9, 2015

Quoting Setting debug log level for individual daemons:

Add -Dhadoop.root.logger=DEBUG to something like HADOOP_resourcemanager_opts in yarn-env.sh

Related questions

Where are logs in Spark on YARN?

I'm new to spark. Now I can run spark 0.9.1 on yarn (2.0.0-cdh4.2.1). But there is no log after execution. The following command is used to run a spark example. But logs are not found in the history server as in …

Read More
Where does Hadoop store the logs of YARN applications?

I run the basic example of Hortonworks' yarn application example. The application fails and I want to read the logs to figure out why. But I can't find any files at the expected location (/HADOOP_INSTALL_FOLDER/logs) where the …

Read More
Why does my yarn application not have logs even with logging enabled?

I have enabled logs in the xml file: yarn-site.xml, and I restarted yarn by doing: sudo service hadoop-yarn-resourcemanager restart sudo service hadoop-yarn-nodemanager restart I ran my application, and then I see the applicationID in yarn application -list. So, I …

Read More