Shulou(Shulou.com)06/01 Report--

This article mainly shows you "what to prepare before DKHadoop installation", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "what you need to prepare before DKHadoop installation" this article.

The configuration of the Hadoop runtime environment can only be understood by those who walk by, but I found a more interesting domestic hadoop distribution-DKHadoop, the fast DKH distribution. DKHadoop integrates a number of common components in the open source community, including HDFS,Hbase,Storm,Flume,Kafka,Mahout,ES, into this platform, so the configuration and installation of the entire runtime environment is greatly simplified.

I sorted out the previous installation process to share with interested friends, mainly divided into: preparation phase, server operating system configuration, DKH system installation, common problem solving four departments. As the article is too long, this article focuses on sharing the first part-the preparatory stage.

Part I: preparatory work

1. Configuration required for big data platform:

(1) system: CentOS 6.564 bit (Desktop is required to be installed by default)

(2) CPU: intel E3 and above.

(3) memory: a minimum of 8 gigabytes is recommended, 32 gigabytes are recommended and 128 gigabytes are recommended.

(4) hard disk: 256g or above, solid state disk is recommended.

(5) system partition requirements: if there are no special needs, except for swap partition, all remaining space can be allocated to / (root) partition

(6) Network requirements: if there are no special circumstances, you can access the external network as far as possible.

(7) at least three servers (the names of three servers are arbitrary, and the password must be the same).

(8) install using root user as default user

2. Remote upload and remote connection tools:

(1) if you directly use the virtual machine enabled by the personal PC as the basis of the server, you can directly copy it to the virtual machine.

(2) if you use the computer room server as the platform to build the server, if you can not directly contact the server, you need to use remote tools to connect and send the installation package.

The above is all the contents of the article "what do you need to prepare before DKHadoop installation"? thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.