Still getting "Unable to load realm info from SCDynamicStore" after bug fix

hadoop apache-pig homebrew
FilmiHero picture FilmiHero · Feb 5, 2013 · Viewed 10.3k times · Source

I installed Hadoop and Pig using brew install hadoop and brew install pig.

I read here that you will to get Unable to load realm info from SCDynamicStore error message unless you add:

export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"

to your hadoop-env.sh file, which I have.

However, when I run hadoop namenode -format, I still see:

java[1548:1703] Unable to load realm info from SCDynamicStore

amongst the outputs.

Anyone know why I'm still getting it?

Answer

user411279 picture user411279 · Jun 25, 2013

As dturnanski suggests, you need to use an older JDK. You can set this in the hadoop-env.sh file by changing the JAVA_HOME setting to:

export JAVA_HOME=`/usr/libexec/java_home -v 1.6`

(Note the grave quotes here.) This fixed the problem for me.

Related questions

Difference between Pig and Hive? Why have both?

My background - 4 weeks old in the Hadoop world. Dabbled a bit in Hive, Pig and Hadoop using Cloudera's Hadoop VM. Have read Google's paper on Map-Reduce and GFS (PDF link). I understand that- Pig's language Pig Latin is a …

Read More
When to use Hadoop, HBase, Hive and Pig?

What are the benefits of using either Hadoop or HBase or Hive ? From my understanding, HBase avoids using map-reduce and has a column oriented storage on top of HDFS. Hive is a sql-like interface for Hadoop and HBase. I would …

Read More
PIG how to count a number of rows in alias

I did something like this to count the number of rows in an alias in PIG: logs = LOAD 'log' logs_w_one = foreach logs generate 1 as one; logs_group = group logs_w_one all; logs_count = foreach logs_group generate …

Read More