Top "Hdfs" questions

Incorrect configuration: namenode address dfs.namenode.rpc-address is not configured

I am getting this error when I try and boot up a DataNode. From what I have read, the RPC …

hadoop hdfs cloudera-cdh

hdfs dfs -mkdir, No such file or directory

Hi I am new to hadoop and trying to create directory in hdfs called twitter_data. I have set up …

hadoop hdfs

issue Running Spark Job on Yarn Cluster

I want to run my spark Job in Hadoop YARN cluster mode, and I am using the following command: spark-submit …

hadoop apache-spark hdfs yarn cloudera

Is there an equivalent to `pwd` in hdfs?

I tried to do hdfs dfs -pwd, but that command does not exist. So currently I am resorting to doing …

hadoop hdfs

Hadoop: ...be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation

I'm getting the following error when attempting to write to HDFS as part of my multi-threaded application could only be …

hadoop configuration hdfs

Where HDFS stores data

I am trying to understand where hadoop stores data in HDFS. I refer to the config files viz: core-site.xml …

hadoop configuration hdfs

Difference between `load data inpath ` and `location` in hive?

At my firm, I see these two commands used frequently, and I'd like to be aware of the differences, because …

sql hadoop hive hdfs hiveql

How to force STORE (overwrite) to HDFS in Pig?

When developing Pig scripts that use the STORE command I have to delete the output directory for every run or …

apache-pig hdfs

localhost: ERROR: Cannot set priority of datanode process 32156

I am trying to install hadoop on ubuntu 16.04 but while starting the hadoop it will give me following error localhost: …

hadoop hdfs datanode

Hadoop: Datanode process killed

I am currently using Hadoop-2.0.3-alpha and after I could work perfectly with HDFS (copying files into HDFS, getting success …

hadoop hdfs