Hadoop 2.2 Installation `.' no such file or directory

hadoop hdfs
Knows Not Much picture Knows Not Much · Dec 29, 2013 · Viewed 38.6k times · Source

I have installed Hadoop and HDFS using this tutorial 

http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html

Everything is fine.

I am also able to create directories and use them using

hadoop fs -mkdir /tmp
hadoop fs -mkdir /small

I can also say

hadoop fs -ls /

However I am following a tutorial in which the trainer does

hadoop fs -mkdir temp
hadoop fs -ls

now on my machine when I issue the above command it says 

ls: `.': No such file or directory

In my training video the command hadoop fs -ls works perfectly. Why should I specify the "/"?

Also I am getting this warning in all my commands

13/12/28 20:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

But in my trainers video there is no such warning.

My configuration file is exactly as the tutorial above and I can also see all management UIs at

http://abhishek-pc:8042/
http://abhishek-pc:50070/
http://abhishek-pc:8088/

So my question is what is wrong with my configuration and why is my system behaving differently than the training video?

Answer

zhutoulala picture zhutoulala · Dec 29, 2013

Well, your problem regarding ls: '.': No such file or directory' is because, there is no home dir on HDFS for your current user. Try

hadoop fs -mkdir -p /user/[current login user]

Then you will be able to hadoop fs -ls

As per this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable, please see my answer at this question

Related questions

Spark - load CSV file as DataFrame?

I would like to read a CSV in spark and convert it as DataFrame and store it in HDFS with df.registerTempTable("table_name") I have tried: scala> val df = sqlContext.load("hdfs:///csv/file/dir/file.csv") Error …

Read More
How to copy file from HDFS to the local file system

How to copy file from HDFS to the local file system . There is no physical location of a file under the file , not even directory . how can i moved them to my local for further validations.i am tried through …

Read More
hadoop copy a local file system folder to HDFS

I need to copy a folder from local file system to HDFS. I could not find any example of moving a folder(including its all subfolders) to HDFS $ hadoop fs -copyFromLocal /home/ubuntu/Source-Folder-To-Copy HDFS-URI

Read More