Shulou(Shulou.com)06/03 Report--

Distributed installation (at least three hosts):

Software required for the environment:

CentOS7

Hadoop-2.7.3.tar.gz

Jdk-8u102-linux-x64.tar.gz

Preparation before installation:

Modify / etc/hosts file

Vim / etc/hosts

Content:

192.168.10.11 bigdata1

192.168.10.12 bigdata2

192.168.10.13 bigdata3

Configure keyless login

Cd

Ssh-keygen-t rsa

Keep entering the car until the end

Ssh-copy-id .ssh / id_rsa.pub bigdata1 ssh-copy-id .ssh / id_rsa.pub bigdata2 ssh-copy-id .ssh / id_rsa.pub bigdata3

Synchronization time

Achieve time synchronization among hosts by setting scheduled tasks

Vim / etc/crontab

0 01 root ntpdate-s time.windows.com

Or deploy a time server for synchronization I will not explain (*) hdfs-site.xml dfs.replication 2 core-site.xml fs.defaultFS hdfs://bigdata1:9000 hadoop.tmp.dir / root/training/hadoop-2.7 in detail here. .3 / tmp mapred-site.xml mapreduce.framework.name yarn yarn-site.xml yarn.resourcemanager.hostname bigdata1 yarn.nodemanager.aux-services mapreduce_shuffle formats NameNode: hdfs Namenode-format log: Storage directory / root/training/hadoop-2.7.3/tmp/dfs/name has been successfully formatted. Scp-r / root/training/hadoop-2.7.3 bigdata2:/root/training/hadoop-2.7.3 scp-r / root/training/hadoop-2.7.3 bigdata3:/root/training/hadoop-2.7.3 launch: start-all.sh = start-dfs.sh + start-yarn.sh Verification (*) Command Line: hdfs dfsadmin-report (*) Web page: HDFS: http://192 .168.157.12: 50070 / Yarn: http://192.168.157.12:8088 (*) Demo: test MapReduce program example: / root/training/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar hadoop jar hadoop-mapreduce-examples-2.7.3.jar wordcount / input/data.txt / output/wc1204

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.