Shulou(Shulou.com)06/01 Report--

This article mainly shows you the "Linux hadoop2.6 how to achieve pseudo-distribution building", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "how to achieve pseudo-distribution building hadoop2.6 in Linux" this article.

First, turn off the firewall

# View firewall status

Service iptables status

# turn off the firewall

Service iptables stop

# check the boot status of the firewall

Chkconfig iptables-list

# turn off the firewall and boot

Chkconfig iptables off

1. Install jdk

Http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

2. Configure the shell script written by the environment variable

3. Compile the shell script written by you

4. Install hadoop download address

Http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.7.2/hadoop-2.7.2.tar.gz

5. Hadoop shell script written

6. The following indicates that hadoop is installed successfully.

II. Modify configuration files (five)

2.1 、

The first one: hadoop-env.sh

# modify it on line 27

Export JAVA_HOME=/usr/java/jdk1.6.0_45

The second one: core-site.xml

Fs.defaultFS

Hdfs://localhost:9000

Hadoop.tmp.dir

/ cloud/hadoop-2.2.0/tmp

The third one: hdfs-site.xml

Dfs.replication

one

Fourth: mapred-site.xml.template needs to be renamed: mv mapred-site.xml.template mapred-site.xml

Mapreduce.framework.name

Yarn

The fifth: yarn-site.xml

Yarn.nodemanager.aux-services

Mapreduce_shuffle

Formatting HDFS (namenode) should be formatted when used for the first time

Hadoop namenode-format

2.3 start hadoop

Start HDFS first

Sbin/start-dfs.sh

Restart YARN

Sbin/start-yarn.sh

2.4. Verify that the startup is successful

Use the jps command to verify

27408 NameNode

28218 Jps

27643 SecondaryNameNode

28066 NodeManager

27803 ResourceManager

27512 DataNode

2.5 、

Http://192.168.0.101:50070 (HDFS Management Interface)

Http://192.168.1.101:8088 (MR Management Interface)

2.6.Configuring ssh login free

Generate ssh login-free key

Cd ~, go to my home directory

Cd .ssh /

Ssh-keygen-t rsa (four carriage returns)

After executing this command, two files, id_rsa (private key) and id_rsa.pub (public key), are generated.

Copy the public key to the machine that will not be logged in

Cat ~ / .ssh/id_rsa.pub > > ~ / .ssh/authorized_keys

Or

Ssh-copy-id-I localhost

These are all the contents of the article "how to build pseudo-distribution in hadoop2.6 in Linux". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.