Ask Ubuntu is a question and answer site for Ubuntu users and developers. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am a just data analyst hails from non cs background (not a hardcore system programmer) working on linux OS. While exploiting analysis using hadoop, a question was coming to my mind that ... / is a root under which all files of your system exists in a hierarchical manner. In hadoop envirorment, a special file system called as HDFS is there which is actually meant to store huge files to be processed by hadoop programming frameworks.

hadoop -fs put localfile.txt 

Although, such files should be accessible under /. so where can i see such files by using cat, less or more linux commands without prefixing hadoop -fs

If, unfortunately i get some error in hadoop/HDFS environment, then how can i acess my data which is still residing on my linux machine.

share|improve this question

Hadoop stores it data locally in forms of block on each datanode and that property is configurable in hdfs-site.xml file under property

In most of the case it is

share|improve this answer

You cannot directly browse HDFS from terminal using cat or similar commands. HDFS is a logical file system and does not directly map to Unix file system. You should have an HDFS client and your Hadoop cluster should be running. When you browse HDFS, you are getting your directory structure from namenode and actual data from datanodes.

Although you cannot browse, data is there stored by datanode daemon. Its path is specified by property in hdfs-site.xml.

Directory structure is stored by namenode daemon and its path is specified by property in hdfs-site.xml

share|improve this answer

You can navigate to all the files who are managed by hadoop by simply writing following command:

More appropriate command is hdfs dfs -ls

The command given on linux terminal will show an output of / directory in which 1st columns shows the file's permissions, 2nd column shows the user of the file and 3rd column shows name of the file

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.