Apache Hadoop is a software framework that supports data-intensive distributed applications under a free license. It enables applications to work with thousands of computational independent computers and petabytes of data. Hadoop was derived from Google's MapReduce and Google File System (GFS) ...

learn more… | top users | synonyms

1
vote
0answers
16 views

Unable to locate package ambari-server in ubuntu 12.04

I'm trying to install ambari server in virtualbox ubuntu 12.04 32 bit. I'm following this installation guide. ...
-3
votes
0answers
21 views

Mapreduce job takes lots of time [closed]

The mapreduce job doesnot proceed from the line: 15/07/24 13:15:25 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032 15/07/24 13:15:28 INFO input.FileInputFormat: Total input ...
0
votes
1answer
18 views

Where can I find Ubuntu images with different packages pre-installed?

I'd like to get an image of the latest Ubuntu with Hadoop configured for a single node so that I don't have to do it myself. Is there a public repository of Ubuntu images somewhere?
0
votes
0answers
9 views

Visualization of data in hadoop

I am doing Server Log file Analysis using map reduce in hadoop.Now I want to show the output of map reduce in form of statistics and graphs.can anybody tell me how to do it.???
0
votes
0answers
23 views

Unable to install cloudera Manager on ubuntu 14.04

I am trying to install CM on Ubuntu 14.04, but getting the following error message in logs: Reading package lists... Building dependency tree... Reading state information... E: Unable to locate ...
0
votes
0answers
13 views

how we can find a string and its co-occurrences from multiple files stored in hdfs?

hadoop 2.6.0 is installed on ubuntu14.04 lts. I want to search a string and its co-occurrences in multiple file stored in hdfs. Plz suggest me the way to do this
0
votes
0answers
21 views

how we can find a string and its occurrences in a single text file in hdfs?

Hadoop2.6.0 is installed on ubuntu 14.04. I want to search a perticular string and its co-occurrences in a single text file.Whereas text file is stored in hdfs.
0
votes
0answers
19 views

How to search a particular string and its occurrences from text file in hadoop 2.6.0

Student survey is conducted at the university which contains field od student rollno,hobby,during their free time what they do,aim,website names they usually visit etc. this whole student survey data ...
0
votes
0answers
33 views

how can i find a string and its occurences in text file in hdfs

I wanted to search a particular string and its occurrences in text file stored in hadoop distributed file system (hdfs). for e.g string is how many students choose listening music as their hobby.
0
votes
0answers
23 views

which password I should need to log in hadoop?

I follow this instruction http://chaalpritam.blogspot.com/2015/05/hadoop-270-single-node-cluster-setup-on.html but when I run this(ssh-keygen -t dsa -P ' ' -f ~/.ssh/id_dsa) command it gives some ...
0
votes
1answer
76 views

“Command not found” message while executing “hadoop namenode -format”

I have followed this tutorial http://www.bogotobogo.com/Hadoop/BigData_hadoop_Install_on_ubuntu_single_node_cluster.php for the hadoop setup upto "Format the new Hadoop File System" and I get the ...
0
votes
0answers
36 views

How to find a particular word occurences from a text file copied in hdfs while running mapreduce example in in hadoop 2.6.0 installed on ubuntu 14.04

I successfully installed the hadoop 2.6.0 on ubutu 14.04 lts and also run the wordcount example easily but now my problem is to find a single word occurences from a text file copied in hdfs in hadoop ...
0
votes
1answer
44 views

start-mapred.sh file not present in Hadoop 2.7.0

I have installed Hadoop 2.7.0 on Ubuntu 14.04. start-dfs.sh,start-yarn.sh and start-all.sh files are in the sbin directory. But start-mapred.sh is not present in the directory. what might be the ...
1
vote
1answer
111 views

mapred-site.xml file not present in Hadoop 2.7.0

I have installed Hadoop 2.7.0 on Ubuntu 14.04. There is no mapred-site.xml file in the hadoop-2.7.0/etc/hadoop directory. But there is a file mapred-site.xml.template in that directory. Are both files ...
0
votes
1answer
42 views

permission problem while installing hadoop?

after extracting hadoop I open my .bashrc file and edit this export HADOOP_HOME="/media/hadoop/linux/soft/hadoop-1.2.1" PATH=$PATH:$HADOOP_HOME/bin export PATH then save and open new terminal and ...
-1
votes
1answer
161 views
0
votes
1answer
22 views

Copying from local in hadoop not working..Can anybody help

hadoopuser@ubuntu:/usr/local/hadoop/bin$ hdfs dfs -copyFromLocal usr/local/tmp/gutenberg /home/hadoopuser/gutenberg 15/06/04 05:02:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library ...
-3
votes
1answer
64 views

HADOOP INSTALLATION.Here is the log file of resource manager..Need Help

2015-06-03 23:52:22,716 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state 2015-06-03 23:52:22,716 INFO ...
0
votes
0answers
36 views

Issue while extracting hadoop jar files

I am trying to install Hadoop on Ubuntu (VirtualBox) with following configuration :- Ubuntu 14.04.2 VirtualBox Windows 8 Hadoop-2.7.0 When I am executing the following command :- bin/hadoop jar ...
0
votes
0answers
67 views

Hadoop Hive unable to move source to destination

I am trying to use Hive 1.2.0 over Hadoop 2.6.0. I have created an employee table. However, when I run the following query: hive> load data local inpath '/home/abc/employeedetails' into table ...
1
vote
1answer
272 views

Passwordless ssh error

I am trying to enable passwordless ssh for Hadoop 2.6.0. The method I tried is as follows: ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys I also ...
0
votes
2answers
78 views

Permission denied error during “hadoop namenode -format” command

I am trying to install single node hadoop cluster using this tutorial. I followed all the steps as mentioned the above link says but I am not able to format the namenode using command hadoop namenode ...
0
votes
0answers
40 views

Start RStudio as different user

While creating Hadoop environment on my PC I have created a user, hduser. Upon this Hadoop environment I have installed RHadoop. But now I face some permission issues when I start R/RStudio and try to ...
2
votes
1answer
105 views

Hadoop in Ubuntu : Unable to create Passwordless SSH

I am learning Hadoop and trying to create the passwordless SSH following the procedure in define in the Book : Hadoop: The Definitive guide Configuring SSH Pseudodistributed mode is just ...
1
vote
3answers
426 views

What is an origin and solution for “port 9000: Connection refused” error?

I am stuggeling with port 9000: Connection refused error. I work on Ubuntu 14.04 and faced the problem when trying to run Hadoop in a non-distributed mode, as a single Java process (compare Hadoop ...
1
vote
1answer
57 views

How to make a respawning Hadoop Upstart job?

You can start a nodemanager instance by running yarn-daemon.sh start nodemanager. If you make an upstart job out if this, you have two problems: The yarn-daemon.sh script will be executed constantly ...
1
vote
1answer
163 views

I have installed hadoop 2. 6 on ubuntu 14.04 i need help in running it

I have a 64-bit Ubuntu 14.04 and I installed single node cluster hadoop 2.6 and all the nodes are running, but when i try to put a sample text file into the hdfs its not working, I have started to ...
0
votes
1answer
130 views

How to install Hadoop on Ubuntu 12.04 32-bit?

I want to install hadoop on my Asus laptop running Ubuntu 12.04. When I tried to format the new File system, at that time I got an error 1. $ hadoop namenode -format or 2. $ hdfs namenode ...
0
votes
1answer
776 views

The node /hbase-unsecure is not in ZooKeeper. Check the value configured in 'zookeeper.znode.parent'

I am getting this error while starting standalone hBase on my ubuntu machine. Please help. Spent a huge amount of time to get it running. :( What I have checked so far - /etc/hosts contains ...
1
vote
1answer
328 views

HBase not connecting to ZooKeeper

I am not able to connect to HBase shell on my local Ubuntu machine. Tried to look all across internet. Not getting what's wrong. In the logs I keep getting this error - ...
0
votes
0answers
121 views

how to resolve mahout installation problem?

[INFO] Apache Mahout ..................................... SUCCESS [0.300s] [INFO] Mahout Build Tools ................................ SUCCESS [0.838s] [INFO] Mahout Eclipse ...
0
votes
0answers
104 views

Job tracker and name node dont start with start-all.sh

Im trying to install hadoop single-node on ubuntu but its not working correctly. When I do start-all.sh name node and job tracker dont start. Do you see in my files what can be be wrong so Im having ...
1
vote
1answer
438 views

Broken packages error while installing zookeeper-server

I am running Ubuntu 14.04 LTS (Trusty) and was trying to install Cloudera Hadoop with Yarn by following this tutorial. Under the options I choose To add the CDH 5 repository: and customized url for ...
0
votes
0answers
3k views

WARN util.NativeCodeLoader unable to load native-hadoop library for your platform

Error: WARN util.NativeCodeLoader unable to load native-hadoop library for your platform ===========================================================================> Added the below lines to .bashrc ...
2
votes
2answers
342 views

Hadoop: Not able to find the start-dfs.sh start-mapred.sh scripts

I have installed Hadoop by following this tutorial. I installed it using ppa. When I reached step 12 : Starting Hadoop Cluster. I got stuck. When I do cd ~/tasdik/hadoop/bin/ It says no such ...
0
votes
0answers
111 views

java.lang.OutOfMemoryError: Java heap space

I'm using Hadoop in my application, but just before the program exits I get this error java.lang.OutOfMemoryError: Java heap space I already modified the mapred-site.xml and added this property to it ...
0
votes
1answer
322 views

Permission denied for root@localhost [duplicate]

I installed ssh on my laptop running Ubuntu 14.04 LTS when I open terminal and type "ssh localhost" it seems to work fine, I get the notice displayed and the last log in time. like below ...
0
votes
1answer
119 views

JAVA path error in hadoop

I installed hadoop watching a youtube video. while I try to run this in terminal it gives me this error srimanth@srimanth-Inspiron-N5110:~$ /usr/local/hadoop-2.6.0/bin/hadoop version ...
0
votes
0answers
33 views

Trouble formatting namenode in hadoop

I'm following some instructions from a cource on udemy and have successfully formatted hdfs once. Now I tried to go back and follow the steps again and am getting the following error: $ hadoop ...
0
votes
1answer
246 views

How to find my Ambari server URL

How do I find my Ambari server hostname? https://ambari.apache.org/1.2.1/installing-hadoop-using-ambari/content/ambari-chap3-1.html
0
votes
0answers
134 views

hadoop: cannot able to create a directory

I just followed the instructions on cloudera.com. Everything is fine. I started hadoop services using for x in `cd /etc/init.d ; ls hadoop-hdfs-*` ; do sudo service $x start ; done I can view ...
1
vote
1answer
169 views

Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

I have just started to work with Hadoop 2. After installing with basic configs, I always failed to run any examples. Has anyone seen this problem and please help me? And the error is something like ...
0
votes
1answer
136 views

How do i figure out which Hadoop version will work on my Ubuntu 14.10 64-bit?

I usually use synaptic but when i type in Hadoop nothing shows up. Show i guess this means i am going to have to build it. I have found what seems to be a hopefully doable set of instructions to ...
0
votes
0answers
188 views

Issue with Bash during Zookeeper Installation [duplicate]

I'm new to this stuff. I get an error during installing ZooKeeper. $ echo 1 > /var/lib/zookeeper/myid bash: /var/lib/zookeeper/myid: Permission denied $ nano ~/.bashrc export ...
0
votes
1answer
33 views

XML info for my computer installing Hadoop

I'm new to this. Where do I find my computer's info to replace this generic XML data? <property> <name>dfs.datanode.data.dir</name> ...
0
votes
0answers
176 views

hbase directory could not create?

I have installed Hadoop and Standalone Hbase 0.98.8 on my virtual ubuntu server. I am trying to install Hbase Pseudo Distrubuted. I did all of steps in there : ...
0
votes
0answers
226 views

Encountering trouble while trying to configure hadoop standalone node

I am following Apache Hadoop 2.5.1 configuration page. I am trying those commands but I get exception message after running the third command. $ mkdir input $ cp etc/hadoop/*.xml input $ bin/hadoop ...
1
vote
1answer
319 views

Uninstalling hadoop on Ubuntu 14.04, files/directories left over

I'm trying to completely uninstall Hadoop on my Ubuntu partition (14.04 Trusty Tahr) and am running into an issue I haven't seen before. I completely removed the directory that hadoop was installed to ...
0
votes
0answers
17 views

Rack number in Hadoop

I have hadoop cluster with 9 nodes. All belongs to /default racks. But I want the setup something similar to this. (All are in same subnets) Rack 0: DataNode1,Datanode2,DataNode3 and top of rack ...
0
votes
0answers
180 views

Error: Could not find or load main class org.apache.pig.Main

When I try to move on into pig local mode, this kind of error occurs: "Error: Could not find or load main class org.apache.pig.Main" Anyone there to solve this issue?