Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
0answers
5 views

In the process of installing Java and Hadoop, my user profile has disappeared?

EDIT::: So when I do edit profile code, it's a different profile. The original one is indeed intact; at least I can open it from the text editor. But how can I reopen the original (proper) profile? ...
0
votes
0answers
5 views

hadoop 2.5.0 default xml references dot-notation environment variables

reviewing the hadoop default.xml files, they refer to many environment vars such as ${hadoop.log.dir} which will not parse (dots are interpreted as separators) in the ubuntu 14.04.1 shell; are these ...
0
votes
0answers
26 views

“hadoop version” getting error

I'm trying to install hadoop 2.4 & jdk8 on ubuntu14.04. I'm following the links: http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've followed carefully above the ...
1
vote
2answers
16 views

hadoop home depricated

I installed hadoop but I'm getting the following error. Can anyone solve this? hadoop@ramesh-H61M-S2P-B3:~$ hadoop -version Warning: $HADOOP_HOME is deprecated. ...
1
vote
3answers
43 views

Not getting `hadoop -version`

I installed Hadoop, but I cannot get its version: ramesh@ramesh-H61M-S2P-B3:~$ echo $HADOOP_HOME /home/hadoop/work/hadoop-1.1.2 ramesh@ramesh-H61M-S2P-B3:~$ hadoop -version hadoop: command not found ...
0
votes
0answers
34 views

ec2, hdfs and hostnames are not resoving

I am trying to setup cloudera 5 hdfs on ec2. I am using rout53 for dns. Below are my modifications. cat /etc/hostname master.hdfs.cloudera.aws.development.west cat /etc/hosts 127.0.0.1 localhost ...
0
votes
0answers
24 views

Hadoop execstack problem

This is my first post ever, so forgive me if this is in the wrong place. I am using Hadoop 2.4.1 on Ubuntu 14.04, and I just set up RHadoop (rmr2 and rhdfs). However I keep receiving this warning ...
0
votes
2answers
222 views

Namenode format and starting the namenode in hadoop2.2.0

I am trying to install Single node configuration, I succeeded to certain point like downloading and unzipping the tar and editing all the configuration files, but faced problems when formatting the ...
1
vote
1answer
92 views

Problem to copy a file from HDFS to local system [copyToLocal: Permission denied]

I have installed and executed an mapreduce program successfully in my system(Ubuntu 14.04). I can see the output file as, hadoopuser@arul-PC:/usr/local/hadoop$ bin/hadoop dfs -ls ...
0
votes
0answers
30 views

Hbase master not running in pseudo-distributed mode

I am trying to run Hbase in a pseudo-distributed mode. I followed the link http://archanaschangale.wordpress.com/2013/08/31/installing-pseudo-distributed-hbase-on-ubuntu/ I am using ubuntu version ...
1
vote
1answer
70 views

How to uninstall Hbase from Ubuntu?

I had installed HBase -0.94 in my Ubuntu system. I want to uninstall it now. I tried, sudo apt-get purge hadoop-hbase but it shows unable to locate package. Help me uninstall it.
0
votes
1answer
117 views

Apache Hadoop 2.4 installation failure on Ubuntu 14.04

I have tried to install the Apache Hadoop 2.4 on Ubuntu 14.04 (32 Bit) os all steps went good but when i try to start the Hadoop Services i am getting the Following Error Message : WARN ...
0
votes
1answer
45 views

Problem in permission to execure python code for Hadoop

I have installed hadoop-1.0.3 and executed an sample program wordcount successfully in my 14.04 following this link. I tried to write program in python by following here. I have copied the ...
0
votes
0answers
20 views

Hadoop Install - Login with Password Failed

I Installed hadoop and restarted the system. Then It's not allowing me to login although I am using the correct password.
0
votes
0answers
40 views

Problem in Working with Hadoop under Eclipse in my system(14.04)

I have already installed hadoop-1.0.3 in my system(14.04 LTS) and executed a sample program 'wordcount' sucessfully. Then I tried to work hadoop under eclipse. I follow this link. I do, $ git clone ...
0
votes
0answers
85 views

hadoop -version command not found [duplicate]

I edited the .bashrc file and set all the paths to the required folders of hadoop . But when running the "hadoop -version" the error was shown "hadoop command not found"
0
votes
1answer
77 views

ERROR : [cat: File does not exist] I can't open hadoop output file in 14.04

I have installed hadoop-1.0.3 in my system(14.04), followed this tutorial. And I successfully run an sample mapreduce program for wordcount as follows, hadoopuser@arul-PC:/usr/local/hadoop$ ...
1
vote
2answers
244 views

Namenode formatting in hadoop installation

I have given the path for both the configuration files directory and the .sh files directory. I managed to do the configurations with this path: ...
0
votes
1answer
627 views

Problem with hadoop start-dfs.sh

I installed and configured hadoop on my Ubuntu 14.04 server, virtualized inside of hyper-v, however I am getting an issue when i run start-dfs.sh root@sUbuntu01:/var/log# start-dfs.sh 14/06/04 ...
0
votes
0answers
36 views

error showing: unable to launch “ PATH=…” X session ---, falling back to default session

When I logged in after successfully installing jdk 1.8.0_05 on Ubuntu 14.04 it says: :unable to launch "PATH=/usr/local/sbin ...... X session --- ...
0
votes
0answers
31 views

how can i run job tracker and task tracker using jps command?

im start to writ command start -all .sh name node and data node and jps are running but task tracker and job tracker not running by using .jps command what's the problem need to compile word count ...
0
votes
1answer
76 views

permission denied errors while starting namenode in hadoop 2.2.0

I recently installed hadoop2.2.0 on my desktop running : Linux livingstream 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Lin I am able to format the ...
0
votes
1answer
204 views

Install native-bzip2 on Ubuntu 14.04

I have recently tried to build Hadoop 2.4 to use it's native libraries. And when I check that if hadoop is really using it. I get the following warning : WARN bzip2.Bzip2Factory: Failed to ...
0
votes
2answers
1k views

How to uninstall or remove Hadoop from Ubuntu ?

I have installed Hadoop-2.4.0 in my system(14.04), I want to remove it completely and reinstall it. If I have delete the configured folder hadoop, is it enough to remove hadoop in my Ubuntu 14.04 LTS. ...
0
votes
1answer
152 views

ERROR: when start hadoop

I am installed Hadoop, following Michael noll's tutorial. When I start name node using as following command, hduser@ARUL-PC:/usr/local/hadoop$ sbin/start-all.sh I got response as, This script is ...
1
vote
1answer
63 views

how to set valid host and domain names in ubuntu 12.04 to avoid Java exceptions?

How could I set a valid host name to avoid this exception Caused by: com.google.protobuf.ServiceException: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host ...
1
vote
1answer
116 views

Error when formatting Hadoop JAVA_HOME is not set

I get the fallowing msj when i try to format my cluster Re-format filesystem in /app/hadoop/tmp/dfs/name ? (Y or N) Y 14/04/28 10:20:16 INFO util.GSet: VM type = 64-bit 14/04/28 10:20:16 INFO ...
0
votes
2answers
386 views

PROBLEM : NOT A VALID JAR for HADOOP example?

I have installed hadoop-2.4.0 in my 14.04 LTS, I have followed this link, I have done upto start and stop services successfully, but when I tried to execute example, $ /bin/hadoop jar ...
0
votes
1answer
151 views

PROBLEM :: Enable SSH for hadoop with new key

I followed michael noll's tutorial for installing hadoop, I created hadoop user as 'hduser' and generated key, but I am stuck in here, when i try to enable ssh access with generated key by using, ...
0
votes
0answers
29 views

Launch Hadoop Cluster in OpenStack

I have installed OpenStack by cloning DevStack along with Sahara. Now I want to know that is there a way to launch a Hadoop Cluster and execute a simple PHP program by using only GUI? I have seen ...
1
vote
1answer
42 views

problem in netstat

I tried to check configured ports from hadoop user as, sudo netstat -p1ten | grep java But, I am getting result as, [sudo] password for hadoopz: hadoopz is not in the sudoers file. This incident ...
0
votes
1answer
197 views

A nifty tool for checking whether the expected Hadoop processes are running is jps :: PROBLEM

hadoopz@ubuntu:/usr/local/hadoop$ jps The program 'jps' can be found in the following packages: openjdk-7-jdk openjdk-6-jdk Ask your administrator to install one of them When I check jps for ...
0
votes
1answer
2k views

Problems using the start-dfs,sh on hadoop 2.2.0

Im using this tutorial for installing hadoop 2.2.0 http://codesfusion.blogspot.in/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've completed many of the steps successfully but I'm stuck over this ...
0
votes
1answer
245 views

Install Sahara in OpenStack

I have already installed OpenStack following the tutorial from here. I want to install Apache Hadoop on OpenStack and I saw here that first I have to install DevStack before I install Sahara(Savanna) ...
3
votes
1answer
2k views

How to disable ipv6 in ubuntu 14.04

To disable ipv6 I have open /etc/sysctl.conf using gedit and paste the following lines at the end of sysctl.conf. net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 ...
0
votes
2answers
854 views

Unable to execute command start-all.sh in Hadoop

GUYS I'm using this tutorial How to install Hadoop? I mean the one made by Luis Alvarado in one of the comments .. So I'm on Ubuntu 13.10 64bit Hadoop version is 2.2.0 Actually I'm a total newbie ...
1
vote
1answer
882 views

Hadoop job tracker and task tracker not running on ubuntu 13.10

I have installed hadoop .20 on my ubuntu 13.10 machine. When I do start-all.sh only name node , data node and secondary node process starts, Job tracker and task tracker doesn't show. I have used the ...
1
vote
0answers
27 views

How to upload & download file using hbase?

I want to fragment the file & download & upload file using HBase.
1
vote
2answers
129 views

No space left on left on Drive after deleting everything. /dev/sda6 100% used

I had recently run a script in our college exam on my computer which was specifically for 32bit(i386) but my ubuntu is amd64 , so the script wouldn't run but then I tried accessing the folders in my ...
0
votes
0answers
216 views

How to use Hadoop streaming input parameter for matlab shell script

Actually i want to execute my matlab code in hadoop streaming. My doubt is how to use hadoop streaming input parameter value for my matlab input. For example , This is my matlab file imreadtest.m ...
0
votes
2answers
145 views

How to upload and download file in hadoop?

I want to upload and download file in hadoop. and want to store file in server or multi-node cluster.
0
votes
0answers
122 views

Ubuntu 12.04 Sever is running slow and not using full ram

I have a ubuntu VM of 12.04 server virsion and it is running on centos. VM have 8GB of RAM and 1 core processor for it. I amd running following application on it hadoop 1.0.4 hbase-0.94.12 ...
0
votes
1answer
143 views

Creating Hadoop Cluster in ubuntu using laptop and desktop

I am learning Hadoop. I want to install Hadoop in such a way that my laptop and desktop are in a cluster. I do have connectivity between them using SSH.
0
votes
2answers
574 views

cannot create hadoop cluster

I have installed hadoop inside /usr/local/hadoop/bin directory and when I try executing the bash script start-all.sh; system gives below error; start-all.sh: command not found Also I don;t see ...
1
vote
1answer
689 views

localhost cant connect to 127.0.0.1

i have some java systems that i want to use hadoop in with it, but whenever i connect to localhost with this command hadoop fs -ls / it will always prompt that java.net.UnknownHostException: ...
1
vote
1answer
2k views

Changing ulimit on ubuntu 12.04 Never works

I am working with hadoop and need to change number of open files ulimit -n. I have seen similar questions on stackoverflow and elsewhere and have tried everything in those answers, but it still does ...
0
votes
1answer
722 views

hadoop fs command is not working in my system

i had install single cluster node on my personal laptop,it has successfully installed and jps also displaying all 5 demons but when i tried to enter into on top of hdfs by using hadoop fs command it ...
1
vote
1answer
146 views

How to extract .snappy format file in Ubuntu?

I executed the compression method program in hadoop by using snappycodec method.the output has came in .snappy format.can anyone help me,How to extract .snappy format file in hadoop ?
0
votes
0answers
117 views

Is it possible for bash autocomplete to work with scripts?

Basically, ive been tasked with getting bash autocomplete working hadoop, but /usr/bin/hdfs is a script that actually sets a path and then calls the actual hdfs "binary". Autocomplete works (there is ...
2
votes
2answers
288 views

Where in linux file system can i see files of Hadoop HDFS?

I am a just data analyst hails from non cs background (not a hardcore system programmer) working on linux OS. While exploiting analysis using hadoop, a question was coming to my mind that ... / is a ...