Shulou(Shulou.com)06/01 Report--

This article is about how hadoop implements pseudo-distributed installation. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Pseudo-distributed installation of 1.hadoop

1.1 set the ip address

Execute the command service network restart

Authentication: ifconfig

1.2 turn off the firewall

Execute the command service iptables stop

Authentication: service iptables status

1.3 turn off the automatic operation of the firewall

Execute the command chkconfig iptables off

Verification: chkconfig-- list | grep iptables

1.4 set hostname

Execute a command

(1) hostname hadoop

(2) vi / etc/sysconfig/network

1.5 ip binds with hostname

Execute the command vi / etc/hosts

Authentication: ping hadoop

1.6 set ssh password-free login

Execute a command

(1) ssh-keygen-t rsa

(2) cp ~ / .ssh/id_rsa.pub ~ / .ssh/authorized_keys

Authentication: ssh hadoop

1.7 install jdk

Execute a command

(1) cd / usr/local

(2) chmod uplix jdk-6u24-linux-i586.bin

(3) / jdk-6u24-linux-i586.bin

(4) mv jdk-1.6.0_24 jdk

(5) the addition of vi / etc/profile is as follows:

Export JAVA_HOME=/usr/local/jdk

Export PATH=.:$JAVA_HOME/bin:$PATH

(6) source / etc/profile

Authentication: java-version

1.8 install hadoop

Execute a command

(1) tar-zxvf hadoop-1.1.2.tar.gz

(2) mv hadoop-1.1.2 hadoop

(3) the addition of vi / etc/profile is as follows:

Export JAVA_HOME=/usr/local/jdk

Export HADOOP_HOME=/usr/local/hadoop

Export PATH=.:$HADOOP_HOME/bin:$JAVA_HOME/bin:$PATH

(4) source / etc/profile

(5) modify the configuration files hadoop-env.sh, core-site.xml, hdfs-site.xml and mapred-site.xml in the conf directory

1.hadoop-env.sh export JAVA_HOME=/usr/local/jdk/

2.core-site.xml

Fs.default.name hdfs://hadoop:9000 hadoop.tmp.dir / usr/local/hadoop/tmp

3.hdfs-site.xml

Dfs.replication 1 dfs.permissions false

4.mapred-site.xml

Mapred.job.tracker hadoop:9001

(6) hadoop namenode-format

(7) start-all.sh

Verify:

(1) execute the command jps. If you see five new java processes, they are NameNode, SecondaryNameNode, DataNode, JobTracker and TaskTracker.

(2) View in the browser, http://hadoop:50070 http://hadoop:50030

1.9 possible reasons why there is no NameNode at startup:

(1) not formatted

(2) incorrect setting of environment variables

(3) failed to bind ip to hostname

Thank you for reading! This is the end of this article on "how to achieve pseudo-distributed installation of hadoop". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it out for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.