Top "Hdfs" questions

There are 0 datanode(s) running and no node(s) are excluded in this operation

I have set up a multi node Hadoop Cluster. The NameNode and Secondary namenode runs on the same machine and …

ubuntu hadoop amazon-ec2 hdfs hadoop2

what's the difference between "hadoop fs" shell commands and "hdfs dfs" shell commands?

Are they supposed to be equal? but, why the "hadoop fs" commands show the hdfs files while the "hdfs dfs" …

hadoop hdfs

Writing to HDFS could only be replicated to 0 nodes instead of minReplication (=1)

I have 3 data nodes running, while running a job i am getting the following given below error , java.io.IOException: …

java hadoop mapreduce hive hdfs

How do I get schema / column names from parquet file?

I have a file stored in HDFS as part-m-00000.gz.parquet I've tried to run hdfs dfs -text dir/part-m-00000.…

hadoop apache-pig hdfs parquet

What should be hadoop.tmp.dir ?

Hadoop has configuration parameter hadoop.tmp.dir which, as per documentation, is `"A base for other temporary directories." I presume, …

hadoop hdfs config

How to specify username when putting files on HDFS from a remote machine

I have a Hadoop cluster setup and working under a common default username "user1". I want to put files into …

hadoop username hdfs

LeaseExpiredException: No lease error on HDFS

I am trying to load large data to HDFS and I sometimes get the error below. any idea why? The …

hadoop hdfs

How to remove files inside the hadoop directory at once?

I want to remove all the files containes in hadoop directory, without removing the directory itself. I've tried using rm …

hadoop hdfs

File count in an HDFS directory

In Java code, I want to connect to a directory in HDFS, learn the number of files in that directory, …

java hadoop hdfs

How to navigate directories in Hadoop HDFS

I would like to navigate in HDFS First i looked on the directories in "root" HDFS [cloudera@localhost ~]$ sudo -u …

hadoop hdfs