Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
1answer
19 views

XML info for my computer installing Hadoop

I'm new to this. Where do I find my computer's info to replace this generic XML data? <property> <name>dfs.datanode.data.dir</name> ...
0
votes
0answers
11 views

hbase directory could not create?

I have installed Hadoop and Standalone Hbase 0.98.8 on my virtual ubuntu server. I am trying to install Hbase Pseudo Distrubuted. I did all of steps in there : ...
0
votes
0answers
21 views

Encountering trouble while trying to configure hadoop standalone node

I am following Apache Hadoop 2.5.1 configuration page. I am trying those commands but I get exception message after running the third command. $ mkdir input $ cp etc/hadoop/*.xml input $ bin/hadoop ...
1
vote
1answer
37 views

Uninstalling hadoop on Ubuntu 14.04, files/directories left over

I'm trying to completely uninstall Hadoop on my Ubuntu partition (14.04 Trusty Tahr) and am running into an issue I haven't seen before. I completely removed the directory that hadoop was installed to ...
0
votes
0answers
11 views

Rack number in Hadoop

I have hadoop cluster with 9 nodes. All belongs to /default racks. But I want the setup something similar to this. (All are in same subnets) Rack 0: DataNode1,Datanode2,DataNode3 and top of rack ...
0
votes
0answers
56 views

Error: Could not find or load main class org.apache.pig.Main

When I try to move on into pig local mode, this kind of error occurs: "Error: Could not find or load main class org.apache.pig.Main" Anyone there to solve this issue?
0
votes
1answer
27 views

Best underlying file system type and configuration for HDFS

I would like to reformat a local drive partition and turn it into a partition for HDFS. Which file system would be most performant for running HDFS on top of it? Any optimizations I should take care ...
0
votes
0answers
41 views

getting java specific error while running namenode or datanode servive on ubuntu 12.04

I recently upgrade openjdk1.6 to openjdk1.7_57. after setting everything including java_home to new path. It's throwing below error: /usr/lib/hadoop-hdfs/bin/hdfs: line 172: exec: ...
0
votes
0answers
37 views

name node formatting HDFS file not found error in Hadoop2.4.0

I have installed my hadoop in /usr/local/hadoop directory when i try to run the commeand $ bin/hdfs namenode -format im the getting the error /usr/local/hadoop/bin/hdfs: line 206: ...
0
votes
1answer
159 views

error in shuffle in fetcher#1 Hadoop

I'm trying to run the Hadoop pi example. It was running without any problems on a single node. But now I'm working on a multinode and its giving the below error. If anyone could please advise. ...
0
votes
0answers
20 views

Transition from single node to multi node hadoop same

I've followed the hadoop single node installation steps from this link . And now following this link to connect them to make a multi-node cluster. I'm in the beginning of the steps and I just have a ...
1
vote
1answer
69 views

No space left on the device though there is space

I am copying file and I got an error message saying "no space left on the device". root@nn:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvda2 ...
0
votes
0answers
58 views

'error unrecognized service' when trying to test cluster

I am trying to follow the instructions on Cloudera's website here [1] to set up a test cluster in pseudo distributed mode. But I am unable to even start any services after formatting the namenode $ ...
0
votes
1answer
92 views

In the process of installing Java and Hadoop, my user profile has disappeared?

So I added the following code to the bottom of profile after: sudo gedit etc/profile Code added to profile: JAVA_HOME=/usr/local/java/jdk1.8.0_20 PATH=$PATH:$JAVA_HOME/bin ...
0
votes
0answers
27 views

hadoop 2.5.0 default xml references dot-notation environment variables

reviewing the hadoop default.xml files, they refer to many environment vars such as ${hadoop.log.dir} which will not parse (dots are interpreted as separators) in the ubuntu 14.04.1 shell; are these ...
0
votes
0answers
42 views

“hadoop version” getting error

I'm trying to install hadoop 2.4 & jdk8 on ubuntu14.04. I'm following the links: http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've followed carefully above the ...
1
vote
2answers
140 views

hadoop home depricated

I installed hadoop but I'm getting the following error. Can anyone solve this? hadoop@ramesh-H61M-S2P-B3:~$ hadoop -version Warning: $HADOOP_HOME is deprecated. ...
1
vote
3answers
1k views

Not getting `hadoop -version`

I installed Hadoop, but I cannot get its version: ramesh@ramesh-H61M-S2P-B3:~$ echo $HADOOP_HOME /home/hadoop/work/hadoop-1.1.2 ramesh@ramesh-H61M-S2P-B3:~$ hadoop -version hadoop: command not found ...
0
votes
0answers
112 views

ec2, hdfs and hostnames are not resoving

I am trying to setup cloudera 5 hdfs on ec2. I am using rout53 for dns. Below are my modifications. cat /etc/hostname master.hdfs.cloudera.aws.development.west cat /etc/hosts 127.0.0.1 localhost ...
0
votes
0answers
47 views

Hadoop execstack problem

This is my first post ever, so forgive me if this is in the wrong place. I am using Hadoop 2.4.1 on Ubuntu 14.04, and I just set up RHadoop (rmr2 and rhdfs). However I keep receiving this warning ...
0
votes
3answers
3k views

Namenode format and starting the namenode in hadoop2.2.0

I am trying to install Single node configuration, I succeeded to certain point like downloading and unzipping the tar and editing all the configuration files, but faced problems when formatting the ...
1
vote
1answer
424 views

Problem to copy a file from HDFS to local system [copyToLocal: Permission denied]

I have installed and executed an mapreduce program successfully in my system(Ubuntu 14.04). I can see the output file as, hadoopuser@arul-PC:/usr/local/hadoop$ bin/hadoop dfs -ls ...
0
votes
0answers
210 views

Hbase master not running in pseudo-distributed mode

I am trying to run Hbase in a pseudo-distributed mode. I followed the link http://archanaschangale.wordpress.com/2013/08/31/installing-pseudo-distributed-hbase-on-ubuntu/ I am using ubuntu version ...
1
vote
1answer
196 views

How to uninstall Hbase from Ubuntu?

I had installed HBase -0.94 in my Ubuntu system. I want to uninstall it now. I tried, sudo apt-get purge hadoop-hbase but it shows unable to locate package. Help me uninstall it.
0
votes
1answer
307 views

Apache Hadoop 2.4 installation failure on Ubuntu 14.04

I have tried to install the Apache Hadoop 2.4 on Ubuntu 14.04 (32 Bit) os all steps went good but when i try to start the Hadoop Services i am getting the Following Error Message : WARN ...
0
votes
1answer
89 views

Problem in permission to execure python code for Hadoop

I have installed hadoop-1.0.3 and executed an sample program wordcount successfully in my 14.04 following this link. I tried to write program in python by following here. I have copied the ...
0
votes
0answers
25 views

Hadoop Install - Login with Password Failed

I Installed hadoop and restarted the system. Then It's not allowing me to login although I am using the correct password.
0
votes
0answers
80 views

Problem in Working with Hadoop under Eclipse in my system(14.04)

I have already installed hadoop-1.0.3 in my system(14.04 LTS) and executed a sample program 'wordcount' sucessfully. Then I tried to work hadoop under eclipse. I follow this link. I do, $ git clone ...
0
votes
0answers
85 views

hadoop -version command not found [duplicate]

I edited the .bashrc file and set all the paths to the required folders of hadoop . But when running the "hadoop -version" the error was shown "hadoop command not found"
0
votes
1answer
188 views

ERROR : [cat: File does not exist] I can't open hadoop output file in 14.04

I have installed hadoop-1.0.3 in my system(14.04), followed this tutorial. And I successfully run an sample mapreduce program for wordcount as follows, hadoopuser@arul-PC:/usr/local/hadoop$ ...
1
vote
2answers
952 views

Namenode formatting in hadoop installation

I have given the path for both the configuration files directory and the .sh files directory. I managed to do the configurations with this path: ...
1
vote
1answer
2k views

Problem with hadoop start-dfs.sh

I installed and configured hadoop on my Ubuntu 14.04 server, virtualized inside of hyper-v, however I am getting an issue when i run start-dfs.sh root@sUbuntu01:/var/log# start-dfs.sh 14/06/04 ...
0
votes
0answers
58 views

error showing: unable to launch “ PATH=…” X session ---, falling back to default session

When I logged in after successfully installing jdk 1.8.0_05 on Ubuntu 14.04 it says: :unable to launch "PATH=/usr/local/sbin ...... X session --- ...
0
votes
0answers
82 views

how can i run job tracker and task tracker using jps command?

im start to writ command start -all .sh name node and data node and jps are running but task tracker and job tracker not running by using .jps command what's the problem need to compile word count ...
0
votes
1answer
421 views

permission denied errors while starting namenode in hadoop 2.2.0

I recently installed hadoop2.2.0 on my desktop running : Linux livingstream 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Lin I am able to format the ...
0
votes
1answer
303 views

Install native-bzip2 on Ubuntu 14.04

I have recently tried to build Hadoop 2.4 to use it's native libraries. And when I check that if hadoop is really using it. I get the following warning : WARN bzip2.Bzip2Factory: Failed to ...
0
votes
2answers
3k views

How to uninstall or remove Hadoop from Ubuntu ?

I have installed Hadoop-2.4.0 in my system(14.04), I want to remove it completely and reinstall it. If I have delete the configured folder hadoop, is it enough to remove hadoop in my Ubuntu 14.04 LTS. ...
0
votes
2answers
275 views

ERROR: when start hadoop

I am installed Hadoop, following Michael noll's tutorial. When I start name node using as following command, hduser@ARUL-PC:/usr/local/hadoop$ sbin/start-all.sh I got response as, This script is ...
1
vote
1answer
114 views

how to set valid host and domain names in ubuntu 12.04 to avoid Java exceptions?

How could I set a valid host name to avoid this exception Caused by: com.google.protobuf.ServiceException: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host ...
1
vote
1answer
251 views

Error when formatting Hadoop JAVA_HOME is not set

I get the fallowing msj when i try to format my cluster Re-format filesystem in /app/hadoop/tmp/dfs/name ? (Y or N) Y 14/04/28 10:20:16 INFO util.GSet: VM type = 64-bit 14/04/28 10:20:16 INFO ...
0
votes
2answers
1k views

PROBLEM : NOT A VALID JAR for HADOOP example?

I have installed hadoop-2.4.0 in my 14.04 LTS, I have followed this link, I have done upto start and stop services successfully, but when I tried to execute example, $ /bin/hadoop jar ...
0
votes
1answer
164 views

PROBLEM :: Enable SSH for hadoop with new key

I followed michael noll's tutorial for installing hadoop, I created hadoop user as 'hduser' and generated key, but I am stuck in here, when i try to enable ssh access with generated key by using, ...
0
votes
0answers
31 views

Launch Hadoop Cluster in OpenStack

I have installed OpenStack by cloning DevStack along with Sahara. Now I want to know that is there a way to launch a Hadoop Cluster and execute a simple PHP program by using only GUI? I have seen ...
1
vote
1answer
49 views

problem in netstat

I tried to check configured ports from hadoop user as, sudo netstat -p1ten | grep java But, I am getting result as, [sudo] password for hadoopz: hadoopz is not in the sudoers file. This incident ...
0
votes
1answer
661 views

A nifty tool for checking whether the expected Hadoop processes are running is jps :: PROBLEM

hadoopz@ubuntu:/usr/local/hadoop$ jps The program 'jps' can be found in the following packages: openjdk-7-jdk openjdk-6-jdk Ask your administrator to install one of them When I check jps for ...
0
votes
1answer
4k views

Problems using the start-dfs,sh on hadoop 2.2.0

Im using this tutorial for installing hadoop 2.2.0 http://codesfusion.blogspot.in/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've completed many of the steps successfully but I'm stuck over this ...
0
votes
1answer
429 views

Install Sahara in OpenStack

I have already installed OpenStack following the tutorial from here. I want to install Apache Hadoop on OpenStack and I saw here that first I have to install DevStack before I install Sahara(Savanna) ...
7
votes
1answer
12k views

How to disable ipv6 in ubuntu 14.04

To disable ipv6 I have open /etc/sysctl.conf using gedit and paste the following lines at the end of sysctl.conf. net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 ...
0
votes
2answers
2k views

Unable to execute command start-all.sh in Hadoop

GUYS I'm using this tutorial How to install Hadoop? I mean the one made by Luis Alvarado in one of the comments .. So I'm on Ubuntu 13.10 64bit Hadoop version is 2.2.0 Actually I'm a total newbie ...
1
vote
1answer
2k views

Hadoop job tracker and task tracker not running on ubuntu 13.10

I have installed hadoop .20 on my ubuntu 13.10 machine. When I do start-all.sh only name node , data node and secondary node process starts, Job tracker and task tracker doesn't show. I have used the ...