Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
0answers
31 views

WARN util.NativeCodeLoader unable to load native-hadoop library for your platform

Error: WARN util.NativeCodeLoader unable to load native-hadoop library for your platform ===========================================================================> Added the below lines to .bashrc ...
2
votes
1answer
20 views

Hadoop: Not able to find the start-dfs.sh start-mapred.sh scripts

I have installed Hadoop by following this tutorial. I installed it using ppa. When I reached step 12 : Starting Hadoop Cluster. I got stuck. When I do cd ~/tasdik/hadoop/bin/ It says no such ...
0
votes
0answers
19 views

java.lang.OutOfMemoryError: Java heap space

I'm using Hadoop in my application, but just before the program exits I get this error java.lang.OutOfMemoryError: Java heap space I already modified the mapred-site.xml and added this property to it ...
0
votes
1answer
76 views

Permission denied for root@localhost [duplicate]

I installed ssh on my laptop running Ubuntu 14.04 LTS when I open terminal and type "ssh localhost" it seems to work fine, I get the notice displayed and the last log in time. like below ...
0
votes
1answer
60 views

JAVA path error in hadoop

I installed hadoop watching a youtube video. while I try to run this in terminal it gives me this error srimanth@srimanth-Inspiron-N5110:~$ /usr/local/hadoop-2.6.0/bin/hadoop version ...
0
votes
0answers
15 views

Trouble formatting namenode in hadoop

I'm following some instructions from a cource on udemy and have successfully formatted hdfs once. Now I tried to go back and follow the steps again and am getting the following error: $ hadoop ...
0
votes
1answer
81 views

How to find my Ambari server URL

How do I find my Ambari server hostname? https://ambari.apache.org/1.2.1/installing-hadoop-using-ambari/content/ambari-chap3-1.html
0
votes
0answers
37 views

hadoop: cannot able to create a directory

I just followed the instructions on cloudera.com. Everything is fine. I started hadoop services using for x in `cd /etc/init.d ; ls hadoop-hdfs-*` ; do sudo service $x start ; done I can view ...
0
votes
0answers
128 views

Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

I have just started to work with Hadoop 2. After installing with basic configs, I always failed to run any examples. Has anyone seen this problem and please help me? And the error is something like ...
0
votes
1answer
66 views

How do i figure out which Hadoop version will work on my Ubuntu 14.10 64-bit?

I usually use synaptic but when i type in Hadoop nothing shows up. Show i guess this means i am going to have to build it. I have found what seems to be a hopefully doable set of instructions to ...
0
votes
0answers
64 views

Issue with Bash during Zookeeper Installation [duplicate]

I'm new to this stuff. I get an error during installing ZooKeeper. $ echo 1 > /var/lib/zookeeper/myid bash: /var/lib/zookeeper/myid: Permission denied $ nano ~/.bashrc export ...
0
votes
1answer
24 views

XML info for my computer installing Hadoop

I'm new to this. Where do I find my computer's info to replace this generic XML data? <property> <name>dfs.datanode.data.dir</name> ...
0
votes
0answers
35 views

hbase directory could not create?

I have installed Hadoop and Standalone Hbase 0.98.8 on my virtual ubuntu server. I am trying to install Hbase Pseudo Distrubuted. I did all of steps in there : ...
0
votes
0answers
99 views

Encountering trouble while trying to configure hadoop standalone node

I am following Apache Hadoop 2.5.1 configuration page. I am trying those commands but I get exception message after running the third command. $ mkdir input $ cp etc/hadoop/*.xml input $ bin/hadoop ...
1
vote
1answer
88 views

Uninstalling hadoop on Ubuntu 14.04, files/directories left over

I'm trying to completely uninstall Hadoop on my Ubuntu partition (14.04 Trusty Tahr) and am running into an issue I haven't seen before. I completely removed the directory that hadoop was installed to ...
0
votes
0answers
13 views

Rack number in Hadoop

I have hadoop cluster with 9 nodes. All belongs to /default racks. But I want the setup something similar to this. (All are in same subnets) Rack 0: DataNode1,Datanode2,DataNode3 and top of rack ...
0
votes
0answers
93 views

Error: Could not find or load main class org.apache.pig.Main

When I try to move on into pig local mode, this kind of error occurs: "Error: Could not find or load main class org.apache.pig.Main" Anyone there to solve this issue?
0
votes
1answer
39 views

Best underlying file system type and configuration for HDFS

I would like to reformat a local drive partition and turn it into a partition for HDFS. Which file system would be most performant for running HDFS on top of it? Any optimizations I should take care ...
0
votes
0answers
88 views

getting java specific error while running namenode or datanode servive on ubuntu 12.04

I recently upgrade openjdk1.6 to openjdk1.7_57. after setting everything including java_home to new path. It's throwing below error: /usr/lib/hadoop-hdfs/bin/hdfs: line 172: exec: ...
0
votes
0answers
123 views

name node formatting HDFS file not found error in Hadoop2.4.0

I have installed my hadoop in /usr/local/hadoop directory when i try to run the commeand $ bin/hdfs namenode -format im the getting the error /usr/local/hadoop/bin/hdfs: line 206: ...
0
votes
1answer
165 views

error in shuffle in fetcher#1 Hadoop

I'm trying to run the Hadoop pi example. It was running without any problems on a single node. But now I'm working on a multinode and its giving the below error. If anyone could please advise. ...
0
votes
0answers
22 views

Transition from single node to multi node hadoop same

I've followed the hadoop single node installation steps from this link . And now following this link to connect them to make a multi-node cluster. I'm in the beginning of the steps and I just have a ...
1
vote
1answer
117 views

No space left on the device though there is space

I am copying file and I got an error message saying "no space left on the device". root@nn:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvda2 ...
0
votes
0answers
75 views

'error unrecognized service' when trying to test cluster

I am trying to follow the instructions on Cloudera's website here [1] to set up a test cluster in pseudo distributed mode. But I am unable to even start any services after formatting the namenode $ ...
0
votes
1answer
156 views

In the process of installing Java and Hadoop, my user profile has disappeared?

So I added the following code to the bottom of profile after: sudo gedit etc/profile Code added to profile: JAVA_HOME=/usr/local/java/jdk1.8.0_20 PATH=$PATH:$JAVA_HOME/bin ...
0
votes
0answers
27 views

hadoop 2.5.0 default xml references dot-notation environment variables

reviewing the hadoop default.xml files, they refer to many environment vars such as ${hadoop.log.dir} which will not parse (dots are interpreted as separators) in the ubuntu 14.04.1 shell; are these ...
0
votes
0answers
48 views

“hadoop version” getting error

I'm trying to install hadoop 2.4 & jdk8 on ubuntu14.04. I'm following the links: http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've followed carefully above the ...
1
vote
2answers
328 views

hadoop home depricated

I installed hadoop but I'm getting the following error. Can anyone solve this? hadoop@ramesh-H61M-S2P-B3:~$ hadoop -version Warning: $HADOOP_HOME is deprecated. ...
1
vote
3answers
2k views

Not getting `hadoop -version`

I installed Hadoop, but I cannot get its version: ramesh@ramesh-H61M-S2P-B3:~$ echo $HADOOP_HOME /home/hadoop/work/hadoop-1.1.2 ramesh@ramesh-H61M-S2P-B3:~$ hadoop -version hadoop: command not found ...
0
votes
0answers
137 views

ec2, hdfs and hostnames are not resoving

I am trying to setup cloudera 5 hdfs on ec2. I am using rout53 for dns. Below are my modifications. cat /etc/hostname master.hdfs.cloudera.aws.development.west cat /etc/hosts 127.0.0.1 localhost ...
0
votes
0answers
54 views

Hadoop execstack problem

This is my first post ever, so forgive me if this is in the wrong place. I am using Hadoop 2.4.1 on Ubuntu 14.04, and I just set up RHadoop (rmr2 and rhdfs). However I keep receiving this warning ...
0
votes
3answers
5k views

Namenode format and starting the namenode in hadoop2.2.0

I am trying to install Single node configuration, I succeeded to certain point like downloading and unzipping the tar and editing all the configuration files, but faced problems when formatting the ...
1
vote
1answer
669 views

Problem to copy a file from HDFS to local system [copyToLocal: Permission denied]

I have installed and executed an mapreduce program successfully in my system(Ubuntu 14.04). I can see the output file as, hadoopuser@arul-PC:/usr/local/hadoop$ bin/hadoop dfs -ls ...
0
votes
1answer
327 views

Hbase master not running in pseudo-distributed mode

I am trying to run Hbase in a pseudo-distributed mode. I followed the link http://archanaschangale.wordpress.com/2013/08/31/installing-pseudo-distributed-hbase-on-ubuntu/ I am using ubuntu version ...
1
vote
1answer
280 views

How to uninstall Hbase from Ubuntu?

I had installed HBase -0.94 in my Ubuntu system. I want to uninstall it now. I tried, sudo apt-get purge hadoop-hbase but it shows unable to locate package. Help me uninstall it.
0
votes
1answer
328 views

Apache Hadoop 2.4 installation failure on Ubuntu 14.04

I have tried to install the Apache Hadoop 2.4 on Ubuntu 14.04 (32 Bit) os all steps went good but when i try to start the Hadoop Services i am getting the Following Error Message : WARN ...
0
votes
1answer
115 views

Problem in permission to execure python code for Hadoop

I have installed hadoop-1.0.3 and executed an sample program wordcount successfully in my 14.04 following this link. I tried to write program in python by following here. I have copied the ...
0
votes
0answers
26 views

Hadoop Install - Login with Password Failed

I Installed hadoop and restarted the system. Then It's not allowing me to login although I am using the correct password.
0
votes
0answers
94 views

Problem in Working with Hadoop under Eclipse in my system(14.04)

I have already installed hadoop-1.0.3 in my system(14.04 LTS) and executed a sample program 'wordcount' sucessfully. Then I tried to work hadoop under eclipse. I follow this link. I do, $ git clone ...
0
votes
0answers
85 views

hadoop -version command not found [duplicate]

I edited the .bashrc file and set all the paths to the required folders of hadoop . But when running the "hadoop -version" the error was shown "hadoop command not found"
0
votes
1answer
260 views

ERROR : [cat: File does not exist] I can't open hadoop output file in 14.04

I have installed hadoop-1.0.3 in my system(14.04), followed this tutorial. And I successfully run an sample mapreduce program for wordcount as follows, hadoopuser@arul-PC:/usr/local/hadoop$ ...
1
vote
2answers
1k views

Namenode formatting in hadoop installation

I have given the path for both the configuration files directory and the .sh files directory. I managed to do the configurations with this path: ...
1
vote
1answer
2k views

Problem with hadoop start-dfs.sh

I installed and configured hadoop on my Ubuntu 14.04 server, virtualized inside of hyper-v, however I am getting an issue when i run start-dfs.sh root@sUbuntu01:/var/log# start-dfs.sh 14/06/04 ...
0
votes
0answers
78 views

error showing: unable to launch “ PATH=…” X session ---, falling back to default session

When I logged in after successfully installing jdk 1.8.0_05 on Ubuntu 14.04 it says: :unable to launch "PATH=/usr/local/sbin ...... X session --- ...
0
votes
0answers
99 views

how can i run job tracker and task tracker using jps command?

im start to writ command start -all .sh name node and data node and jps are running but task tracker and job tracker not running by using .jps command what's the problem need to compile word count ...
0
votes
1answer
577 views

permission denied errors while starting namenode in hadoop 2.2.0

I recently installed hadoop2.2.0 on my desktop running : Linux livingstream 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Lin I am able to format the ...
0
votes
1answer
372 views

Install native-bzip2 on Ubuntu 14.04

I have recently tried to build Hadoop 2.4 to use it's native libraries. And when I check that if hadoop is really using it. I get the following warning : WARN bzip2.Bzip2Factory: Failed to ...
0
votes
2answers
4k views

How to uninstall or remove Hadoop from Ubuntu ?

I have installed Hadoop-2.4.0 in my system(14.04), I want to remove it completely and reinstall it. If I have delete the configured folder hadoop, is it enough to remove hadoop in my Ubuntu 14.04 LTS. ...
0
votes
2answers
294 views

ERROR: when start hadoop

I am installed Hadoop, following Michael noll's tutorial. When I start name node using as following command, hduser@ARUL-PC:/usr/local/hadoop$ sbin/start-all.sh I got response as, This script is ...
1
vote
1answer
135 views

how to set valid host and domain names in ubuntu 12.04 to avoid Java exceptions?

How could I set a valid host name to avoid this exception Caused by: com.google.protobuf.ServiceException: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host ...