Shulou(Shulou.com)06/02 Report--

This article introduces the relevant knowledge of "how to realize the machine information distribution table of Hadoop cluster". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

1. Build a distributed environment

Use 4 machines with Linux environment installed to build a small distributed cluster.

Figure 1 the architecture of the cluster

One of the machines is a Master node, the name node, and the other three are Slaver nodes, or data nodes. The four machines are connected to each other through routers to communicate with each other and transmit data. All of them can access Internet through router to collect web pages and documents.

2. Cluster machine details

2.1 Master Server

Name

detailed information

Machine name

Master.Hadoop

Machine IP address

192.168.1.2

* user name (Name)

Root

Most user password (PWD)

Hadoop (all lowercase)

General user name (Name)

Hadoop (all lowercase)

General user password (PWD)

Hadoop (all lowercase)

2.2 Slave1 Server

Name

detailed information

Machine name

Slave1.Hadoop

Machine IP address

192.168.1.3

* user name (Name)

Root

Most user password (PWD)

Hadoop (all lowercase)

General user name (Name)

Hadoop (all lowercase)

General user password (PWD)

Hadoop (all lowercase)

2.3 Slave2 Server

Name

detailed information

Machine name

Slave2.Hadoop

Machine IP address

192.168.1.4

* user name (Name)

Root

Most user password (PWD)

Hadoop (all lowercase)

General user name (Name)

Hadoop (all lowercase)

General user password (PWD)

Hadoop (all lowercase)

2.4 Slave3 Server

Name

detailed information

Machine name

Slave3.Hadoop

Machine IP address

192.168.1.5

* user name (Name)

Root

Most user password (PWD)

Hadoop (all lowercase)

General user name (Name)

Hadoop (all lowercase)

General user password (PWD)

Hadoop (all lowercase)

Remarks:

Add new user command: useradd; modify new user password: passwd username

Exit current user: exit; login root user: su-

3. Actual layout of cluster machines

The following is the deployment of several actual machines of the Hadoop cluster, and you can see how we actually configured the Hadoop cluster at that time.

3.1 Hadoop work Cluster

The Hadoop cluster machine is used for learning and research, running the built Hadoop platform and running some actual programs.

Figure 3.1-1 deployment diagram of Hadoop work cluster (1)

Figure 3.1-2 deployment diagram of Hadoop work cluster (2)

The Hadoop cluster deployment is viewed from two angles. As the Master node of the Hadoop cluster, the new Dell with good machines is used, while the three Slave machines are the old Lenovo eliminated in the laboratory. They form a local area network with a small router.

Figure 3.1-3 Router close-up

3.2 Hadoop experimental cluster

In order to facilitate new members to practice Hadoop technology, and to prevent the destruction of running programs on the actual Hadoop cluster, two other old Lenovo computers are made up of one "master-TMaster" and one "auxiliary-TSlave".

Figure 3.2-1 Hadoop experimental cluster deployment

This is the end of the content of "how to implement the Hadoop cluster machine information distribution table". Thank you for your reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.