Shulou(Shulou.com)06/01 Report--

This article mainly introduces how to install pseudo-distributed Hadoop, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

Install pseudo-distributed Hadoop

Http://blog.csdn.net/ggz631047367/article/details/42426391

Sudo vi / usr/local/hadoop/etc/hadoop/hadoop-env.sh

Modify the HADOOP_OPTS in hadoop-env.sh:

Export HADOOP_OPTS= "- Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native"

Export HADOOP_OPTS= "- Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native"

Sudo gedit / .bashrc

# HADOOP VARIABLES START

Export JAVA_HOME=/usr/java/jdk1.7.0_75

Export HADOOP_INSTALL=/usr/local/hadoop

Export PATH=$PATH:$HADOOP_INSTALL/bin

Export PATH=$PATH:$HADOOP_INSTALL/sbin

Export HADOOP_MAPRED_HOME=$HADOOP_INSTALL

Export HADOOP_COMMON_HOME=$HADOOP_INSTALL

Export HADOOP_HDFS_HOME=$HADOOP_INSTALL

Export YARN_HOME=$HADOOP_INSTALL

Export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native

Export HADOOP_OPTS= "- Djava.library.path=$HADOOP_INSTALL/lib"

# HADOOP VARIABLES END

Bin/hadoop jar share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.7.1-sources.jar org.apache.hadoop.examples.WordCount input output

Sudo vi / usr/local/hadoop/etc/hadoop/core-site.xml

Sudo vi / usr/local/hadoop/etc/hadoop/mapred-site.xml

Sudo vi / usr/local/hadoop/etc/hadoop/yarn-site.xml

Sudo vi / usr/local/hadoop/etc/hadoop/hdfs-site.xml

Dfs.replication

one

Dfs.namenode.name.dir

File:/usr/local/hadoop/dfs/name

Dfs.datanode.data.dir

File:/usr/local/hadoop/dfs/data

Dfs.permissions

False

Sudo vi / usr/local/hadoop/etc/hadoop/masters add: localhost

Sudo vi / usr/local/hadoop/etc/hadoop/slaves add: localhost

Thank you for reading this article carefully. I hope the article "how to install pseudo-distributed Hadoop" shared by the editor will be helpful to you. At the same time, I also hope you will support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.