Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
1answer
5 views

Permission denied error during “hadoop namenode -format” command

I am trying to install single node hadoop cluster using this tutorial. I followed all the steps as mentioned the above link says but I am not able to format the namenode using command hadoop namenode ...
0
votes
0answers
9 views

Start RStudio as different user

While creating Hadoop environment on my PC I have created a user, hduser. Upon this Hadoop environment I have installed RHadoop. But now I face some permission issues when I start R/RStudio and try to ...
1
vote
1answer
23 views

Hadoop in Ubuntu : Unable to create Passwordless SSH

I am learning Hadoop and trying to create the passwordless SSH following the procedure in define in the Book : Hadoop: The Definitive guide Configuring SSH Pseudodistributed mode is just ...
1
vote
3answers
158 views

What is an origin and solution for “port 9000: Connection refused” error?

I am stuggeling with port 9000: Connection refused error. I work on Ubuntu 14.04 and faced the problem when trying to run Hadoop in a non-distributed mode, as a single Java process (compare Hadoop ...
1
vote
1answer
20 views

How to make a respawning Hadoop Upstart job?

You can start a nodemanager instance by running yarn-daemon.sh start nodemanager. If you make an upstart job out if this, you have two problems: The yarn-daemon.sh script will be executed constantly ...
1
vote
1answer
67 views

I have installed hadoop 2. 6 on ubuntu 14.04 i need help in running it

I have a 64-bit Ubuntu 14.04 and I installed single node cluster hadoop 2.6 and all the nodes are running, but when i try to put a sample text file into the hdfs its not working, I have started to ...
0
votes
1answer
46 views

How to install Hadoop on Ubuntu 12.04 32-bit?

I want to install hadoop on my Asus laptop running Ubuntu 12.04. When I tried to format the new File system, at that time I got an error 1. $ hadoop namenode -format or 2. $ hdfs namenode ...
0
votes
1answer
278 views

The node /hbase-unsecure is not in ZooKeeper. Check the value configured in 'zookeeper.znode.parent'

I am getting this error while starting standalone hBase on my ubuntu machine. Please help. Spent a huge amount of time to get it running. :( What I have checked so far - /etc/hosts contains ...
1
vote
1answer
89 views

HBase not connecting to ZooKeeper

I am not able to connect to HBase shell on my local Ubuntu machine. Tried to look all across internet. Not getting what's wrong. In the logs I keep getting this error - ...
0
votes
0answers
69 views

how to resolve mahout installation problem?

[INFO] Apache Mahout ..................................... SUCCESS [0.300s] [INFO] Mahout Build Tools ................................ SUCCESS [0.838s] [INFO] Mahout Eclipse ...
0
votes
0answers
72 views

Job tracker and name node dont start with start-all.sh

Im trying to install hadoop single-node on ubuntu but its not working correctly. When I do start-all.sh name node and job tracker dont start. Do you see in my files what can be be wrong so Im having ...
1
vote
1answer
183 views

Broken packages error while installing zookeeper-server

I am running Ubuntu 14.04 LTS (Trusty) and was trying to install Cloudera Hadoop with Yarn by following this tutorial. Under the options I choose To add the CDH 5 repository: and customized url for ...
0
votes
0answers
1k views

WARN util.NativeCodeLoader unable to load native-hadoop library for your platform

Error: WARN util.NativeCodeLoader unable to load native-hadoop library for your platform ===========================================================================> Added the below lines to .bashrc ...
2
votes
1answer
122 views

Hadoop: Not able to find the start-dfs.sh start-mapred.sh scripts

I have installed Hadoop by following this tutorial. I installed it using ppa. When I reached step 12 : Starting Hadoop Cluster. I got stuck. When I do cd ~/tasdik/hadoop/bin/ It says no such ...
0
votes
0answers
59 views

java.lang.OutOfMemoryError: Java heap space

I'm using Hadoop in my application, but just before the program exits I get this error java.lang.OutOfMemoryError: Java heap space I already modified the mapred-site.xml and added this property to it ...
0
votes
1answer
178 views

Permission denied for root@localhost [duplicate]

I installed ssh on my laptop running Ubuntu 14.04 LTS when I open terminal and type "ssh localhost" it seems to work fine, I get the notice displayed and the last log in time. like below ...
0
votes
1answer
89 views

JAVA path error in hadoop

I installed hadoop watching a youtube video. while I try to run this in terminal it gives me this error srimanth@srimanth-Inspiron-N5110:~$ /usr/local/hadoop-2.6.0/bin/hadoop version ...
0
votes
0answers
27 views

Trouble formatting namenode in hadoop

I'm following some instructions from a cource on udemy and have successfully formatted hdfs once. Now I tried to go back and follow the steps again and am getting the following error: $ hadoop ...
0
votes
1answer
171 views

How to find my Ambari server URL

How do I find my Ambari server hostname? https://ambari.apache.org/1.2.1/installing-hadoop-using-ambari/content/ambari-chap3-1.html
0
votes
0answers
95 views

hadoop: cannot able to create a directory

I just followed the instructions on cloudera.com. Everything is fine. I started hadoop services using for x in `cd /etc/init.d ; ls hadoop-hdfs-*` ; do sudo service $x start ; done I can view ...
1
vote
1answer
161 views

Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

I have just started to work with Hadoop 2. After installing with basic configs, I always failed to run any examples. Has anyone seen this problem and please help me? And the error is something like ...
0
votes
1answer
113 views

How do i figure out which Hadoop version will work on my Ubuntu 14.10 64-bit?

I usually use synaptic but when i type in Hadoop nothing shows up. Show i guess this means i am going to have to build it. I have found what seems to be a hopefully doable set of instructions to ...
0
votes
0answers
137 views

Issue with Bash during Zookeeper Installation [duplicate]

I'm new to this stuff. I get an error during installing ZooKeeper. $ echo 1 > /var/lib/zookeeper/myid bash: /var/lib/zookeeper/myid: Permission denied $ nano ~/.bashrc export ...
0
votes
1answer
26 views

XML info for my computer installing Hadoop

I'm new to this. Where do I find my computer's info to replace this generic XML data? <property> <name>dfs.datanode.data.dir</name> ...
0
votes
0answers
99 views

hbase directory could not create?

I have installed Hadoop and Standalone Hbase 0.98.8 on my virtual ubuntu server. I am trying to install Hbase Pseudo Distrubuted. I did all of steps in there : ...
0
votes
0answers
195 views

Encountering trouble while trying to configure hadoop standalone node

I am following Apache Hadoop 2.5.1 configuration page. I am trying those commands but I get exception message after running the third command. $ mkdir input $ cp etc/hadoop/*.xml input $ bin/hadoop ...
1
vote
1answer
189 views

Uninstalling hadoop on Ubuntu 14.04, files/directories left over

I'm trying to completely uninstall Hadoop on my Ubuntu partition (14.04 Trusty Tahr) and am running into an issue I haven't seen before. I completely removed the directory that hadoop was installed to ...
0
votes
0answers
15 views

Rack number in Hadoop

I have hadoop cluster with 9 nodes. All belongs to /default racks. But I want the setup something similar to this. (All are in same subnets) Rack 0: DataNode1,Datanode2,DataNode3 and top of rack ...
0
votes
0answers
137 views

Error: Could not find or load main class org.apache.pig.Main

When I try to move on into pig local mode, this kind of error occurs: "Error: Could not find or load main class org.apache.pig.Main" Anyone there to solve this issue?
0
votes
1answer
55 views

Best underlying file system type and configuration for HDFS

I would like to reformat a local drive partition and turn it into a partition for HDFS. Which file system would be most performant for running HDFS on top of it? Any optimizations I should take care ...
0
votes
0answers
116 views

getting java specific error while running namenode or datanode servive on ubuntu 12.04

I recently upgrade openjdk1.6 to openjdk1.7_57. after setting everything including java_home to new path. It's throwing below error: /usr/lib/hadoop-hdfs/bin/hdfs: line 172: exec: ...
0
votes
1answer
289 views

name node formatting HDFS file not found error in Hadoop2.4.0

I have installed my hadoop in /usr/local/hadoop directory when i try to run the commeand $ bin/hdfs namenode -format im the getting the error /usr/local/hadoop/bin/hdfs: line 206: ...
0
votes
1answer
173 views

error in shuffle in fetcher#1 Hadoop

I'm trying to run the Hadoop pi example. It was running without any problems on a single node. But now I'm working on a multinode and its giving the below error. If anyone could please advise. ...
0
votes
1answer
34 views

Transition from single node to multi node hadoop same

I've followed the hadoop single node installation steps from this link . And now following this link to connect them to make a multi-node cluster. I'm in the beginning of the steps and I just have a ...
1
vote
1answer
216 views

No space left on the device though there is space

I am copying file and I got an error message saying "no space left on the device". root@nn:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvda2 ...
0
votes
1answer
107 views

'error unrecognized service' when trying to test cluster

I am trying to follow the instructions on Cloudera's website here [1] to set up a test cluster in pseudo distributed mode. But I am unable to even start any services after formatting the namenode $ ...
0
votes
1answer
228 views

In the process of installing Java and Hadoop, my user profile has disappeared?

So I added the following code to the bottom of profile after: sudo gedit etc/profile Code added to profile: JAVA_HOME=/usr/local/java/jdk1.8.0_20 PATH=$PATH:$JAVA_HOME/bin ...
0
votes
0answers
31 views

hadoop 2.5.0 default xml references dot-notation environment variables

reviewing the hadoop default.xml files, they refer to many environment vars such as ${hadoop.log.dir} which will not parse (dots are interpreted as separators) in the ubuntu 14.04.1 shell; are these ...
0
votes
0answers
56 views

“hadoop version” getting error

I'm trying to install hadoop 2.4 & jdk8 on ubuntu14.04. I'm following the links: http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've followed carefully above the ...
1
vote
2answers
565 views

hadoop home depricated

I installed hadoop but I'm getting the following error. Can anyone solve this? hadoop@ramesh-H61M-S2P-B3:~$ hadoop -version Warning: $HADOOP_HOME is deprecated. ...
1
vote
3answers
4k views

Not getting `hadoop -version`

I installed Hadoop, but I cannot get its version: ramesh@ramesh-H61M-S2P-B3:~$ echo $HADOOP_HOME /home/hadoop/work/hadoop-1.1.2 ramesh@ramesh-H61M-S2P-B3:~$ hadoop -version hadoop: command not found ...
0
votes
0answers
163 views

ec2, hdfs and hostnames are not resoving

I am trying to setup cloudera 5 hdfs on ec2. I am using rout53 for dns. Below are my modifications. cat /etc/hostname master.hdfs.cloudera.aws.development.west cat /etc/hosts 127.0.0.1 localhost ...
0
votes
0answers
63 views

Hadoop execstack problem

This is my first post ever, so forgive me if this is in the wrong place. I am using Hadoop 2.4.1 on Ubuntu 14.04, and I just set up RHadoop (rmr2 and rhdfs). However I keep receiving this warning ...
0
votes
3answers
7k views

Namenode format and starting the namenode in hadoop2.2.0

I am trying to install Single node configuration, I succeeded to certain point like downloading and unzipping the tar and editing all the configuration files, but faced problems when formatting the ...
1
vote
1answer
997 views

Problem to copy a file from HDFS to local system [copyToLocal: Permission denied]

I have installed and executed an mapreduce program successfully in my system(Ubuntu 14.04). I can see the output file as, hadoopuser@arul-PC:/usr/local/hadoop$ bin/hadoop dfs -ls ...
0
votes
1answer
526 views

Hbase master not running in pseudo-distributed mode

I am trying to run Hbase in a pseudo-distributed mode. I followed the link http://archanaschangale.wordpress.com/2013/08/31/installing-pseudo-distributed-hbase-on-ubuntu/ I am using ubuntu version ...
1
vote
1answer
416 views

How to uninstall Hbase from Ubuntu?

I had installed HBase -0.94 in my Ubuntu system. I want to uninstall it now. I tried, sudo apt-get purge hadoop-hbase but it shows unable to locate package. Help me uninstall it.
0
votes
1answer
343 views

Apache Hadoop 2.4 installation failure on Ubuntu 14.04

I have tried to install the Apache Hadoop 2.4 on Ubuntu 14.04 (32 Bit) os all steps went good but when i try to start the Hadoop Services i am getting the Following Error Message : WARN ...
0
votes
1answer
154 views

Problem in permission to execure python code for Hadoop

I have installed hadoop-1.0.3 and executed an sample program wordcount successfully in my 14.04 following this link. I tried to write program in python by following here. I have copied the ...
0
votes
0answers
26 views

Hadoop Install - Login with Password Failed

I Installed hadoop and restarted the system. Then It's not allowing me to login although I am using the correct password.