Shulou(Shulou.com)06/02 Report--

This article will explain in detail how to build a Hadoop cluster in Docker. The content of the article is of high quality, so the editor will share it with you for reference. I hope you will have some understanding of the relevant knowledge after reading this article.

Download the hadoop image, which will be used when the startup script creates the container, or you can download it directly after the startup script. The version can be defined by yourself.

2. Download the open source project above github. The creation and image version of the above node has been written. It should be noted here that if the version downloaded above has been changed, the image version in the corresponding script should also be modified, otherwise it will be downloaded again.

Third, bridge the network to facilitate communication between containers. One master and two slaves are created by default.

The startup script is used to create the container

Here you just create three container nodes, start hadoop, and execute scripts under the master node to create dfs and yarn

5. There is an optional script for testing under the master node.

6. Enter http://localhost:50070 in the browser; http://localhost:8088 can see the record of the test script just executed.

On how to build a Hadoop cluster in Docker to share here, I hope the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.