Shulou(Shulou.com)06/03 Report--

For Hadoop, there are two main aspects, one is distributed file system HDFS, the other is MapReduce computing model. The running environment of building Hadoop is mainly divided into three kinds: independent mode environment, pseudo-distributed environment and completely distributed environment.

Stand-alone mode: also known as stand-alone mode. This mode runs on a single machine, there is no distributed file system, but directly reads and writes the file system of the local operating system, there is no daemon, all programs run in the same JVM, which is convenient for debugging and testing, and is mainly used in the development environment.

Second, pseudo-distributed: hadoop runs on a single machine, but simulates a small cluster, runs in different JVM, and imitates all kinds of nodes in distributed operation with different Java processes.

(NameNode,DataNode,JobTracker,TaskTracker,SecondaryNameNode)

Third, completely distributed: hadoop runs on different hosts, that is, on a cluster of hosts, realizing true distribution.

Next, I would like to share the process of building a stand-alone mode Hadoop environment on centOS6.7 (my test is effective), and the other two modes will be updated gradually.

Step 1: install the rzsz command

Step 2: create a directory for storing software packages

Step 3: upload linux version of jdk package

Step 4: install jdk

Step 5: configure the environment variables of java

Step 6: upload the Hadoop installation package

Step 7: extract the hadoop installation software and move the directory to the program directory

Step 8: configure hadoop environment variables

Step 9: test whether it is successful

If you see this effect, it proves that your hadoop has been installed successfully.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.