Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
0answers
11 views

Hadoop execstack problem

This is my first post ever, so forgive me if this is in the wrong place. I am using Hadoop 2.4.1 on Ubuntu 14.04, and I just set up RHadoop (rmr2 and rhdfs). However I keep receiving this warning ...
-1
votes
0answers
29 views

after running nutch on existing hadoop cluster error java.lang.NullPointerException

Currently i have two ubuntu VMs on a windows 8 host. both of them are connected to the internet and both of them can ping each other . first i installed hadoop 1.2.1 and test it on cluster mode and ...
0
votes
1answer
47 views

Namenode format and starting the namenode in hadoop2.2.0

I am trying to install Single node configuration, I succeeded to certain point like downloading and unzipping the tar and editing all the configuration files, but faced problems when formatting the ...
1
vote
1answer
34 views

Problem to copy a file from HDFS to local system [copyToLocal: Permission denied]

I have installed and executed an mapreduce program successfully in my system(Ubuntu 14.04). I can see the output file as, hadoopuser@arul-PC:/usr/local/hadoop$ bin/hadoop dfs -ls ...
0
votes
0answers
13 views

Hbase master not running in pseudo-distributed mode

I am trying to run Hbase in a pseudo-distributed mode. I followed the link http://archanaschangale.wordpress.com/2013/08/31/installing-pseudo-distributed-hbase-on-ubuntu/ I am using ubuntu version ...
1
vote
1answer
38 views

How to uninstall Hbase from Ubuntu?

I had installed HBase -0.94 in my Ubuntu system. I want to uninstall it now. I tried, sudo apt-get purge hadoop-hbase but it shows unable to locate package. Help me uninstall it.
0
votes
0answers
43 views

Apache Hadoop 2.4 installation failure on Ubuntu 14.04

I have tried to install the Apache Hadoop 2.4 on Ubuntu 14.04 (32 Bit) os all steps went good but when i try to start the Hadoop Services i am getting the Following Error Message : WARN ...
0
votes
1answer
35 views

Problem in permission to execure python code for Hadoop

I have installed hadoop-1.0.3 and executed an sample program wordcount successfully in my 14.04 following this link. I tried to write program in python by following here. I have copied the ...
0
votes
0answers
15 views

Hadoop Install - Login with Password Failed

I Installed hadoop and restarted the system. Then It's not allowing me to login although I am using the correct password.
0
votes
0answers
22 views

Problem in Working with Hadoop under Eclipse in my system(14.04)

I have already installed hadoop-1.0.3 in my system(14.04 LTS) and executed a sample program 'wordcount' sucessfully. Then I tried to work hadoop under eclipse. I follow this link. I do, $ git clone ...
0
votes
0answers
27 views

hadoop -version command not found

I edited the .bashrc file and set all the paths to the required folders of hadoop . But when running the "hadoop -version" the error was shown "hadoop command not found"
0
votes
1answer
49 views

Unable to start Hadoop [on hold]

I'm done installing hadoop and java and SSH server but when executing command start-dfs.sh I am getting the following error 14/06/17 17:19:53 WARN util.NativeCodeLoader: Unable to load ...
0
votes
1answer
43 views

ERROR : [cat: File does not exist] I can't open hadoop output file in 14.04

I have installed hadoop-1.0.3 in my system(14.04), followed this tutorial. And I successfully run an sample mapreduce program for wordcount as follows, hadoopuser@arul-PC:/usr/local/hadoop$ ...
1
vote
2answers
118 views

Namenode formatting in hadoop installation

I have given the path for both the configuration files directory and the .sh files directory. I managed to do the configurations with this path: ...
-1
votes
1answer
193 views

Problem with hadoop start-dfs.sh

I installed and configured hadoop on my Ubuntu 14.04 server, virtualized inside of hyper-v, however I am getting an issue when i run start-dfs.sh root@sUbuntu01:/var/log# start-dfs.sh 14/06/04 ...
0
votes
0answers
22 views

error showing: unable to launch “ PATH=…” X session ---, falling back to default session

When I logged in after successfully installing jdk 1.8.0_05 on Ubuntu 14.04 it says: :unable to launch "PATH=/usr/local/sbin ...... X session --- ...
0
votes
0answers
18 views

how can i run job tracker and task tracker using jps command?

im start to writ command start -all .sh name node and data node and jps are running but task tracker and job tracker not running by using .jps command what's the problem need to compile word count ...
0
votes
0answers
28 views

Hadoop:Only master node does the work

I've setup a Hadoop 2.2 cluster with 1 master node(namenode and secondary namenode) and 3 slave nodes(datanode and namenode on each one).All of the machines use Linux Mint 64bit. When I run my ...
0
votes
1answer
56 views

permission denied errors while starting namenode in hadoop 2.2.0

I recently installed hadoop2.2.0 on my desktop running : Linux livingstream 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Lin I am able to format the ...
0
votes
1answer
136 views

Install native-bzip2 on Ubuntu 14.04

I have recently tried to build Hadoop 2.4 to use it's native libraries. And when I check that if hadoop is really using it. I get the following warning : WARN bzip2.Bzip2Factory: Failed to ...
0
votes
2answers
583 views

How to uninstall or remove Hadoop from Ubuntu ?

I have installed Hadoop-2.4.0 in my system(14.04), I want to remove it completely and reinstall it. If I have delete the configured folder hadoop, is it enough to remove hadoop in my Ubuntu 14.04 LTS. ...
0
votes
1answer
111 views

ERROR: when start-all.sh in hadoop & hadoop-env.sh~ has created automatically

I am installed Hadoop, following Michael noll's tutorial. When I start name node using as following command, hduser@ARUL-PC:/usr/local/hadoop$ sbin/start-all.sh I got response as, This script is ...
1
vote
1answer
40 views

how to set valid host and domain names in ubuntu 12.04 to avoid Java exceptions?

How could I set a valid host name to avoid this exception Caused by: com.google.protobuf.ServiceException: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host ...
0
votes
0answers
85 views

How to install PIG and execute in ubuntu?

I have installed Hadoop-2.4.0, for big data processing, I required pig programming for data analytics. Please some one tell me how to install and execute an pig program in my ubuntu 14.04 .
0
votes
0answers
139 views

copyFromLocal: `/user/hduser/gutenberg': No such file or directory, stuck in HDFS?

I am working on Hadoop, I followed michael noll's tutorial, I have installed and start single node sucessfully, I have stored those text files he said in "/tmp/txtfile/(that i have created)", But ...
1
vote
1answer
83 views

Error when formatting Hadoop JAVA_HOME is not set

I get the fallowing msj when i try to format my cluster Re-format filesystem in /app/hadoop/tmp/dfs/name ? (Y or N) Y 14/04/28 10:20:16 INFO util.GSet: VM type = 64-bit 14/04/28 10:20:16 INFO ...
0
votes
0answers
237 views

PROBLEM : NOT A VALID JAR for HADOOP example ?

I have installed hadoop-2.4.0 in my 14.04 LTS, I have followed this link, I have done upto start and stop services successfully, but when I tried to execute example, $ /bin/hadoop jar ...
0
votes
1answer
147 views

PROBLEM :: Enable SSH for hadoop with new key

I followed michael noll's tutorial for installing hadoop, I created hadoop user as 'hduser' and generated key, but I am stuck in here, when i try to enable ssh access with generated key by using, ...
0
votes
0answers
22 views

How to install and configure Apache Hive in Ubuntu 13.04? [duplicate]

I have download hive-0.12.0.tar.gz from this mirror please help me hoe to install and configure in my system which running on 13.10 operating system. Note: I already installed Hadoop.
0
votes
0answers
26 views

Launch Hadoop Cluster in OpenStack

I have installed OpenStack by cloning DevStack along with Sahara. Now I want to know that is there a way to launch a Hadoop Cluster and execute a simple PHP program by using only GUI? I have seen ...
1
vote
1answer
41 views

problem in netstat

I tried to check configured ports from hadoop user as, sudo netstat -p1ten | grep java But, I am getting result as, [sudo] password for hadoopz: hadoopz is not in the sudoers file. This incident ...
0
votes
1answer
111 views

A nifty tool for checking whether the expected Hadoop processes are running is jps :: PROBLEM

hadoopz@ubuntu:/usr/local/hadoop$ jps The program 'jps' can be found in the following packages: openjdk-7-jdk openjdk-6-jdk Ask your administrator to install one of them When I check jps for ...
0
votes
1answer
2k views

Problems using the start-dfs,sh on hadoop 2.2.0

Im using this tutorial for installing hadoop 2.2.0 http://codesfusion.blogspot.in/2013/10/setup-hadoop-2x-220-on-ubuntu.html I've completed many of the steps successfully but I'm stuck over this ...
0
votes
1answer
212 views

Install Sahara in OpenStack

I have already installed OpenStack following the tutorial from here. I want to install Apache Hadoop on OpenStack and I saw here that first I have to install DevStack before I install Sahara(Savanna) ...
1
vote
1answer
209 views

can't disable ipv6 in ubuntu 14.04

i paste the lines below in /etc/sysctl.conf at the end: net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.lo.disable_ipv6 = 1 then I tried, $ cat ...
0
votes
2answers
601 views

Unable to execute command start-all.sh in Hadoop

GUYS I'm using this tutorial How to install Hadoop? I mean the one made by Luis Alvarado in one of the comments .. So I'm on Ubuntu 13.10 64bit Hadoop version is 2.2.0 Actually I'm a total newbie ...
1
vote
1answer
638 views

Hadoop job tracker and task tracker not running on ubuntu 13.10

I have installed hadoop .20 on my ubuntu 13.10 machine. When I do start-all.sh only name node , data node and secondary node process starts, Job tracker and task tracker doesn't show. I have used the ...
1
vote
0answers
25 views

How to upload & download file using hbase?

I want to fragment the file & download & upload file using HBase.
0
votes
0answers
73 views

How to get matlab input from hadoop streaming -input

I am using matlab for image processing. Now i want to deploy this in hadoop streaming for grid computing purpose. how to invoke my input from hadoop streaming -input. I got error when i did like this ...
1
vote
2answers
114 views

No space left on left on Drive after deleting everything. /dev/sda6 100% used

I had recently run a script in our college exam on my computer which was specifically for 32bit(i386) but my ubuntu is amd64 , so the script wouldn't run but then I tried accessing the folders in my ...
0
votes
0answers
208 views

How to use Hadoop streaming input parameter for matlab shell script

Actually i want to execute my matlab code in hadoop streaming. My doubt is how to use hadoop streaming input parameter value for my matlab input. For example , This is my matlab file imreadtest.m ...
0
votes
2answers
89 views

How to upload and download file in hadoop?

I want to upload and download file in hadoop. and want to store file in server or multi-node cluster.
0
votes
0answers
109 views

Ubuntu 12.04 Sever is running slow and not using full ram

I have a ubuntu VM of 12.04 server virsion and it is running on centos. VM have 8GB of RAM and 1 core processor for it. I amd running following application on it hadoop 1.0.4 hbase-0.94.12 ...
0
votes
1answer
129 views

Creating Hadoop Cluster in ubuntu using laptop and desktop

I am learning Hadoop. I want to install Hadoop in such a way that my laptop and desktop are in a cluster. I do have connectivity between them using SSH.
0
votes
2answers
445 views

cannot create hadoop cluster

I have installed hadoop inside /usr/local/hadoop/bin directory and when I try executing the bash script start-all.sh; system gives below error; start-all.sh: command not found Also I don;t see ...
1
vote
1answer
533 views

localhost cant connect to 127.0.0.1

i have some java systems that i want to use hadoop in with it, but whenever i connect to localhost with this command hadoop fs -ls / it will always prompt that java.net.UnknownHostException: ...
1
vote
1answer
1k views

Changing ulimit on ubuntu 12.04 Never works

I am working with hadoop and need to change number of open files ulimit -n. I have seen similar questions on stackoverflow and elsewhere and have tried everything in those answers, but it still does ...
0
votes
1answer
575 views

hadoop fs command is not working in my system

i had install single cluster node on my personal laptop,it has successfully installed and jps also displaying all 5 demons but when i tried to enter into on top of hdfs by using hadoop fs command it ...
1
vote
1answer
129 views

How to extract .snappy format file in Ubuntu?

I executed the compression method program in hadoop by using snappycodec method.the output has came in .snappy format.can anyone help me,How to extract .snappy format file in hadoop ?
0
votes
0answers
104 views

Is it possible for bash autocomplete to work with scripts?

Basically, ive been tasked with getting bash autocomplete working hadoop, but /usr/bin/hdfs is a script that actually sets a path and then calls the actual hdfs "binary". Autocomplete works (there is ...