Shulou(Shulou.com)06/01 Report--

What are the main points of installing hadoop, many novices are not very clear about this, in order to help you solve this problem, the following small series will explain in detail for everyone, people who have this need can learn, I hope you can gain something.

1. Install JDK

tar -zxvf jdk-7u75-linux-i586.tar.gz -C /root/training/

vi ~/.bash_profile

JAVA_HOME=/root/training/jdk1.7.0_75

export JAVA_HOME

PATH=$JAVA_HOME/bin:$PATH

export PATH

source ~/.bash_profile

vi /etc/selinux/config SELINUX=disabled

You can view the environment variable vi /etc/profile

Hadoop Configuration Environment

vi ~/.bash_profile

HADOOP_HOME=/root/training/hadoop-2.4.1

export HADOOP_HOME

PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH

export PATH

To validate environment variables:

source ~/.bash_profile

The requested URL/etc/hadoop/was not found on this serverhadoop-env.sh

27 #export JAVA_HOME=${JAVA_HOME}

28 export JAVA_HOME=/root/training/jdk1.7.0_75

You can write an example to test.

I love Beijing

I love China

Beijing is the capital of China

Run: hadoop jar hadoop-mapreduce-examples-2.4.1.jar wordcount <$/data/input/data. txt ~/data/output

install pseudo-distribution pattern

dfs.replication

1

fs.defaultFS

hdfs://192.168.106.2:9000

hadoop.tmp.dir

/root/training/hadoop-2.4.1/tmp

yarn.resourcemanager.hostname

192.168.137.111

yarn.nodemanager.aux-services

mapreduce_shuffle

(*) Format HDFS

hdfs namenode -format

Start Hadoop

start-all.sh

------------------------

1. Generate key pair

ssh-keygen -t rsa

2) Give public keys to others

ssh-copy-id -i .ssh/id_rsa.pub root@192.168.137.111

Renaming: .ssh/authorized_keys

/root/training/hadoop-2.4.1/etc/hadoop/hadoop-env.sh

You can change the cache

Did reading the above help you? If you still want to have further understanding of related knowledge or read more related articles, please pay attention to the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.