Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

0
votes
0answers
5 views

Hadoop 2.5.0 installation

Hello i need to install hadoop 2.5.0 for university course but can't find a tutorial which installs this version. need help. Can't use Vm procedure which university suggest bcz Vm works very slow on ...
0
votes
0answers
11 views

which is the best way to learn Hadoop

I am trying to learn Hadoop, I am good in Java, Linux and Oracle so I am trying to do it myself. But the options are confusing. So please tell the best way to learn hadoop. 1. What distro of Linux is ...
-1
votes
0answers
17 views

which Linux distros is suitable for learning hadoop

I am using ubuntu 14.04 booting along side windows 8 on hp pro book 450 g1, I am not able to run the hadoop successfully in it, I followed all the steps given in the apache site but some problem will ...
0
votes
0answers
26 views

Hadoop Datanode unable to connect to Namenode

STARTUP_MSG: host = mslave/10.160.2.241 STARTUP_MSG: args = [] STARTUP_MSG: version = 2.6.0 t -r e3496499ecb8d220fba99dc5ed4c99c8f9e33bb1; compiled by 'jenkins' on 2014-11-13T21:10Z STARTUP_MSG: ...
0
votes
0answers
8 views

Slave DataNode not doing work despite looking up and healthy

I have a two node Haoop 2.7.1 installation on Ubuntu 12.04 LTS. All the demons are up and running after sbin/start-dfs.sh && sbin/start-yarn.sh as confirmed by jps. However, only the Master ...
1
vote
1answer
41 views

I forgot my localhost root password

I installed Hadoop on my machine. To start it, I was logging in as the user named hduser. I connected to the ssh port using ssh localhost command. Then I went to the bin folder of hadoop to start ...
-1
votes
0answers
21 views

How to install sshd on ubundu14.04 LTS for hadoop?

I tried to install sshd on my ubundu 14.04 LTS version for hadoop and i tried to connect with localhost but it showing error message like ssh: connect to host localhost port 22: connection refused.
0
votes
1answer
17 views

Authentication failure in Hadoop

I have already installed Hadoop and already added user as hduser to group, but I have forgotten the password of the user i.e. hduser. When running su hduser from the terminal I get the result: su: ...
0
votes
0answers
31 views

moving hadoop installation into /usr/local/hadoop

I want to move the Hadoop installation to the /usr/local/hadoop directory, but i time it says ~/hadoop-2.6.0$ sudo mv * /usr/local/hadoop mv: target ‘/usr/local/hadoop’ is not a directory
1
vote
0answers
33 views

Unable to locate package ambari-server in ubuntu 12.04

I'm trying to install ambari server in virtualbox ubuntu 12.04 32 bit. I'm following this installation guide. ...
0
votes
1answer
19 views

Where can I find Ubuntu images with different packages pre-installed?

I'd like to get an image of the latest Ubuntu with Hadoop configured for a single node so that I don't have to do it myself. Is there a public repository of Ubuntu images somewhere?
0
votes
0answers
10 views

Visualization of data in hadoop

I am doing Server Log file Analysis using map reduce in hadoop.Now I want to show the output of map reduce in form of statistics and graphs.can anybody tell me how to do it.???
0
votes
0answers
33 views

Unable to install cloudera Manager on ubuntu 14.04

I am trying to install CM on Ubuntu 14.04, but getting the following error message in logs: Reading package lists... Building dependency tree... Reading state information... E: Unable to locate ...
0
votes
0answers
15 views

how we can find a string and its co-occurrences from multiple files stored in hdfs?

hadoop 2.6.0 is installed on ubuntu14.04 lts. I want to search a string and its co-occurrences in multiple file stored in hdfs. Plz suggest me the way to do this
0
votes
0answers
26 views

how we can find a string and its occurrences in a single text file in hdfs?

Hadoop2.6.0 is installed on ubuntu 14.04. I want to search a perticular string and its co-occurrences in a single text file.Whereas text file is stored in hdfs.
0
votes
0answers
40 views

How to search a particular string and its occurrences from text file in hadoop 2.6.0

Student survey is conducted at the university which contains field od student rollno,hobby,during their free time what they do,aim,website names they usually visit etc. this whole student survey data ...
0
votes
0answers
44 views

how can i find a string and its occurences in text file in hdfs

I wanted to search a particular string and its occurrences in text file stored in hadoop distributed file system (hdfs). for e.g string is how many students choose listening music as their hobby.
0
votes
0answers
38 views

which password I should need to log in hadoop?

I follow this instruction http://chaalpritam.blogspot.com/2015/05/hadoop-270-single-node-cluster-setup-on.html but when I run this(ssh-keygen -t dsa -P ' ' -f ~/.ssh/id_dsa) command it gives some ...
0
votes
1answer
137 views

“Command not found” message while executing “hadoop namenode -format”

I have followed this tutorial http://www.bogotobogo.com/Hadoop/BigData_hadoop_Install_on_ubuntu_single_node_cluster.php for the hadoop setup upto "Format the new Hadoop File System" and I get the ...
0
votes
0answers
39 views

How to find a particular word occurences from a text file copied in hdfs while running mapreduce example in in hadoop 2.6.0 installed on ubuntu 14.04

I successfully installed the hadoop 2.6.0 on ubutu 14.04 lts and also run the wordcount example easily but now my problem is to find a single word occurences from a text file copied in hdfs in hadoop ...
0
votes
1answer
71 views

start-mapred.sh file not present in Hadoop 2.7.0

I have installed Hadoop 2.7.0 on Ubuntu 14.04. start-dfs.sh,start-yarn.sh and start-all.sh files are in the sbin directory. But start-mapred.sh is not present in the directory. what might be the ...
2
votes
1answer
174 views

mapred-site.xml file not present in Hadoop 2.7.0

I have installed Hadoop 2.7.0 on Ubuntu 14.04. There is no mapred-site.xml file in the hadoop-2.7.0/etc/hadoop directory. But there is a file mapred-site.xml.template in that directory. Are both files ...
0
votes
1answer
55 views

permission problem while installing hadoop?

after extracting hadoop I open my .bashrc file and edit this export HADOOP_HOME="/media/hadoop/linux/soft/hadoop-1.2.1" PATH=$PATH:$HADOOP_HOME/bin export PATH then save and open new terminal and ...
-1
votes
1answer
289 views
0
votes
1answer
24 views

Copying from local in hadoop not working..Can anybody help

hadoopuser@ubuntu:/usr/local/hadoop/bin$ hdfs dfs -copyFromLocal usr/local/tmp/gutenberg /home/hadoopuser/gutenberg 15/06/04 05:02:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library ...
-3
votes
1answer
83 views

HADOOP INSTALLATION.Here is the log file of resource manager..Need Help

2015-06-03 23:52:22,716 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state 2015-06-03 23:52:22,716 INFO ...
0
votes
0answers
49 views

Issue while extracting hadoop jar files

I am trying to install Hadoop on Ubuntu (VirtualBox) with following configuration :- Ubuntu 14.04.2 VirtualBox Windows 8 Hadoop-2.7.0 When I am executing the following command :- bin/hadoop jar ...
0
votes
0answers
75 views

Hadoop Hive unable to move source to destination

I am trying to use Hive 1.2.0 over Hadoop 2.6.0. I have created an employee table. However, when I run the following query: hive> load data local inpath '/home/abc/employeedetails' into table ...
1
vote
1answer
689 views

Passwordless ssh error

I am trying to enable passwordless ssh for Hadoop 2.6.0. The method I tried is as follows: ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys I also ...
0
votes
2answers
129 views

Permission denied error during “hadoop namenode -format” command

I am trying to install single node hadoop cluster using this tutorial. I followed all the steps as mentioned the above link says but I am not able to format the namenode using command hadoop namenode ...
0
votes
0answers
60 views

Start RStudio as different user

While creating Hadoop environment on my PC I have created a user, hduser. Upon this Hadoop environment I have installed RHadoop. But now I face some permission issues when I start R/RStudio and try to ...
2
votes
1answer
124 views

Hadoop in Ubuntu : Unable to create Passwordless SSH

I am learning Hadoop and trying to create the passwordless SSH following the procedure in define in the Book : Hadoop: The Definitive guide Configuring SSH Pseudodistributed mode is just ...
1
vote
3answers
577 views

What is an origin and solution for “port 9000: Connection refused” error?

I am stuggeling with port 9000: Connection refused error. I work on Ubuntu 14.04 and faced the problem when trying to run Hadoop in a non-distributed mode, as a single Java process (compare Hadoop ...
1
vote
1answer
68 views

How to make a respawning Hadoop Upstart job?

You can start a nodemanager instance by running yarn-daemon.sh start nodemanager. If you make an upstart job out if this, you have two problems: The yarn-daemon.sh script will be executed constantly ...
1
vote
1answer
198 views

I have installed hadoop 2. 6 on ubuntu 14.04 i need help in running it

I have a 64-bit Ubuntu 14.04 and I installed single node cluster hadoop 2.6 and all the nodes are running, but when i try to put a sample text file into the hdfs its not working, I have started to ...
0
votes
1answer
169 views

How to install Hadoop on Ubuntu 12.04 32-bit?

I want to install hadoop on my Asus laptop running Ubuntu 12.04. When I tried to format the new File system, at that time I got an error 1. $ hadoop namenode -format or 2. $ hdfs namenode ...
1
vote
1answer
968 views

The node /hbase-unsecure is not in ZooKeeper. Check the value configured in 'zookeeper.znode.parent'

I am getting this error while starting standalone hBase on my ubuntu machine. Please help. Spent a huge amount of time to get it running. :( What I have checked so far - /etc/hosts contains ...
1
vote
1answer
470 views

HBase not connecting to ZooKeeper

I am not able to connect to HBase shell on my local Ubuntu machine. Tried to look all across internet. Not getting what's wrong. In the logs I keep getting this error - ...
0
votes
0answers
130 views

how to resolve mahout installation problem?

[INFO] Apache Mahout ..................................... SUCCESS [0.300s] [INFO] Mahout Build Tools ................................ SUCCESS [0.838s] [INFO] Mahout Eclipse ...
0
votes
0answers
110 views

Job tracker and name node dont start with start-all.sh

Im trying to install hadoop single-node on ubuntu but its not working correctly. When I do start-all.sh name node and job tracker dont start. Do you see in my files what can be be wrong so Im having ...
1
vote
1answer
518 views

Broken packages error while installing zookeeper-server

I am running Ubuntu 14.04 LTS (Trusty) and was trying to install Cloudera Hadoop with Yarn by following this tutorial. Under the options I choose To add the CDH 5 repository: and customized url for ...
0
votes
0answers
4k views

WARN util.NativeCodeLoader unable to load native-hadoop library for your platform

Error: WARN util.NativeCodeLoader unable to load native-hadoop library for your platform ===========================================================================> Added the below lines to .bashrc ...
2
votes
2answers
480 views

Hadoop: Not able to find the start-dfs.sh start-mapred.sh scripts

I have installed Hadoop by following this tutorial. I installed it using ppa. When I reached step 12 : Starting Hadoop Cluster. I got stuck. When I do cd ~/tasdik/hadoop/bin/ It says no such ...
0
votes
0answers
125 views

java.lang.OutOfMemoryError: Java heap space

I'm using Hadoop in my application, but just before the program exits I get this error java.lang.OutOfMemoryError: Java heap space I already modified the mapred-site.xml and added this property to it ...
0
votes
1answer
394 views

Permission denied for root@localhost [duplicate]

I installed ssh on my laptop running Ubuntu 14.04 LTS when I open terminal and type "ssh localhost" it seems to work fine, I get the notice displayed and the last log in time. like below ...
0
votes
1answer
134 views

JAVA path error in hadoop

I installed hadoop watching a youtube video. while I try to run this in terminal it gives me this error srimanth@srimanth-Inspiron-N5110:~$ /usr/local/hadoop-2.6.0/bin/hadoop version ...
0
votes
0answers
34 views

Trouble formatting namenode in hadoop

I'm following some instructions from a cource on udemy and have successfully formatted hdfs once. Now I tried to go back and follow the steps again and am getting the following error: $ hadoop ...
0
votes
1answer
268 views

How to find my Ambari server URL

How do I find my Ambari server hostname? https://ambari.apache.org/1.2.1/installing-hadoop-using-ambari/content/ambari-chap3-1.html
0
votes
0answers
146 views

hadoop: cannot able to create a directory

I just followed the instructions on cloudera.com. Everything is fine. I started hadoop services using for x in `cd /etc/init.d ; ls hadoop-hdfs-*` ; do sudo service $x start ; done I can view ...
1
vote
1answer
171 views

Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

I have just started to work with Hadoop 2. After installing with basic configs, I always failed to run any examples. Has anyone seen this problem and please help me? And the error is something like ...