Shulou(Shulou.com)06/01 Report--

This article will explain in detail how to deploy hadoop. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article.

Three modes of Hadoop:

Standalone Operation stand-alone mode, no development, no production, no process.

Pseudo-Distributed Operation pseudo-distributed development does not produce independent processes but is only deployed on one machine

Fully-Distributed Operation distributed development produces independent processes but is only deployed on n machines

Deployment:

1. Decompression

Command: tar-xzvf hadoop-2.8.1.tar.gz

two。 Configure the hosts file

Vi / etc/hosts and then add your own IP and machine name to the tail

Such as:

3. Modify permissions

4. Configuration file

Part1:

Switch to the hadoop user and then switch to my hadoop resource directory

Get the configuration code from the official website and add it to the configuration configuration

Change localhost to our own ID

Part2: directive: vi etc/hadoop/hdfs-site.xml modify file hdfs-site.xml

5. No password ssh

Enter the instruction ssh-keygen-t rsa-P''- f ~ / .ssh/id_rsa

Continue to execute cat ~ / .ssh/id_rsa.pub > > ~ / .ssh/authorized_keys

Chmod 0600 ~ / .ssh/authorized_keys

After the instruction has been executed, it is checked with ssh 192.168.137.252, and it succeeds if the result is still your own.

Here you may want to set the entry password for the hadoop user, you can go to the root user to use the command passwd hadoop (which can be your hadoop user name).

6.namenode formatting

First switch users to hadoop users, then we jump to / opt/software/hadoop.... That is, under the file directory of hadoop, enter the instruction bin/hdfs namenode-format, and if the error is reported as (WARN net.DNS: Unable to determine local hostname-falling back to "localhost" java.net.UnknownHostException: ruozehadoop001.localdomain: ruozehadoop001.localdomain: unknown error

), we need to enter the file / etc/sysconfig/network, and vi edits it to look like this:

If there is no error, the result is:

7. Start

Or enter the file vi etc/hadoop/hadoop-env.sh in vi under the hadoop file directory, and press I to modify the content at the end of the file as shown below:

Input instruction: if sbin/start-dfs.sh gets the result as shown in the figure, it will be successful:

Enter JPS to view the results as follows:

This is the end of the article on "how to deploy hadoop". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.