Shulou(Shulou.com)05/31 Report--

Editor to share with you how to deploy hadoop2.5.1 pseudo-distribution, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

Environment: Ubuntu 12.10 jdk 1.7

There is no need to elaborate on the download and installation of JDK and SSH, there are a lot of materials on the Internet.

Configure login-free commands:

$ssh-keygen-t dsa-P''- f ~ / .ssh/id_dsa $cat ~ / .ssh/id_dsa.pub > > ~ / .ssh/authorized_keys

After compiling the source code, copy / data/hadoop-2.5.1-src/hadoop-dist/hadoop-2.5.1.tar.gz to the / data directory

Decompress tar-xvf hadoop-2.5.1.tar.gz

Configure etc/hadoop/core-site.xml:

Fs.defaultFS hdfs://localhost:9000

Configure etc/hadoop/hdfs-site.xml:

Dfs.replication 1

Configure the configuration file etc/hadoop/mapred-site.xml for YARN:

Mapreduce.framework.name yarn

Configure etc/hadoop/yarn-site.xml:

Yarn.nodemanager.aux-services mapreduce_shuffle

Start / stop namenode and datanode commands

Cd / data/hadoop-2.5.1

Sbin/start-dfs.sh

Sbin/stop-dfs.sh

Start / stop YARN command

Sbin/start-yarn.sh

Sbin/stop-yarn.sh

Verify the command:

Bin/hdfs namenode-format

Bin/hdfs dfs-put etc/hadoop input

Namenode address: http://localhost:50070/

ResourceManager address: http://localhost:8088/

These are all the contents of the article "how to deploy hadoop2.5.1 pseudo-distribution". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.