Shulou(Shulou.com)06/01 Report--

This article mainly introduces "the method of building the stand-alone environment of Hadoop". In the daily operation, I believe that many people have doubts about the method of building the stand-alone environment of Hadoop. The editor has consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts of "the method of building stand-alone environment of Hadoop". Next, please follow the editor to study!

# Hadoop environment #

# # operating system # # I use Mac, in fact, Mac system is also a branch of Linux, using RedHat,CenterOS,Ubuntu and so on is the same. It is not recommended to install Hadoop under windows

# # installation premise # #

Java

SSH

# # get Hadoop installation package # #

This is my own Baidu. I use hadoop-2.3.0.

# # upload the downloaded hadoop installation package to the / usr/local directory of the Linux server using the FTP tool

# # decompressing hadoop package

Cd / usr/local/ tar-zxvf hadoop-2.3.0.tar.gz

# # setting Environment variables

Vi / etc/profile

Add environment variable: export HADOOP_HOME=/usr/local/hadoop-2.3.0

Add hadoop to the PATH variable: PATH = $HADOOP_HOME/bin:$PATH

Make environment variables effective: source / etc/profile

# # modify Hadoop configuration file # #

# modify hdfs-site.xml###

Dfs.replication 1 dfs.permissions false

# modify core-site.xml

Fs.default.name hdfs://localhost:9000 hadoop.tmp.dir / usr/local/hadoop-2.3.0

# modify mapred-site.xml

Mapred.job.tracker localhost:9001

# modify hadoop-env.sh

Add a line: (fill in according to the personal Java installation path)

Export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home

# # so far, the installation and configuration of hadoop has been ok##

Format the HDFS system first:

Hadoop namenode-format

Then we can start hadoop.

Cd / usr/local/hadoop-2.3.0/sbin

. / start-all.sh

If there is no obvious error at startup, the installation is successful.

# # verify the directory created by hadoop fs-mkdir / D1 # hadoop fs-ls / # View the root directory

At this point, the study on "the method of building a stand-alone environment for Hadoop" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.