Locating Cloudera Manager HDFS config files

Sam Hammamy picture Sam Hammamy · Oct 30, 2012 · Viewed 7k times · Source

I've installed a cluster via Cloudera Manager, and now I need to launch the cluster manually.

I've been using the following command:

$ sudo -u hdfs hadoop namenode / datanode / jobtracker

But then the dfs.name.dir is set up /tmp. I can't seem to find where cloudera manager has the HDFS config files. The ones in /usr/lib/hadoop-02*/conf seem to be minimal. They're missing the dfs.name.dir which is what I'm looking for particularly. I'm on an RHLE 6 system, by the way. Being lazy, I though I could just copy over cloudera manager's HDFS config files, so I don't have to manually create them, the copy them over to 6 nodes :)

Thanks

Answer

rational picture rational · Dec 28, 2012

I was facing same problem. I was changing configuration parameters from cloudera manager ui but was clueless where my changes were getting updated on local file system.

I ran grep command and found out that in my case configuration were stored at /var/run/cloudera-scm-agent/process/*-hdfs-NAMENODE directory.

So David is right, whenever we change configs from ui and restart service, it creates new config. settings in /var/run/cloudera-scm-agent/process/ directory.