In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-03-31 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >
Share
Shulou(Shulou.com)06/03 Report--
Foreword:
In previous articles, we introduced the configuration and startup of HDFS components. Yarn is the resource and job scheduling platform for Hadoop clusters. The following describes the pseudo-distributed deployment of Yarn and the simple use of MapReduce.
1. Configuration file and launch [hadoop@hadoop000 hadoop] $pwd/opt/software/hadoop-2.8.1/etc/hadoop [hadoop@hadoop000 hadoop] $cp mapred-site.xml.template mapred-site.xml [hadoop@hadoop000 hadoop] $vi mapred-site.xml mapreduce.framework.name yarn [hadoop@hadoop000 hadoop] $vi yarn-site.xml yarn.nodemanager.aux-services mapreduce_shuffle [hadoop@hadoop000 hadoop] $ Cd / opt/software/hadoop-2.8.1 [hadoop@hadoop000 hadoop-2.8.1] $sbin/start-yarn.shstarting yarn daemonsstarting resourcemanager Logging to / opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop000.out192.168.6.217: starting nodemanager Logging to / opt/software/hadoop-2.8.1/logs/yarn-hadoop-nodemanager-hadoop000.out [hadoop@hadoop000 hadoop-2.8.1] $jps10512 ResourceManager-- process of Yarn 10004 SecondaryNameNode9655 NameNode10936 Jps9806 DataNode10623 NodeManager-- process of Yarn # two processes of Yarn: ResourceManager (Resource Management) NodeManager (Node Management) # refer to the official website: http://hadoop.apache.org/docs/r2.8.4/hadoop-project-dist/hadoop-common/SingleCluster.html2.Yarn website Test
3.MapReduce Job test [hadoop@hadoop000 hadoop-2.8.1] $pwd/opt/software/hadoop-2.8.1 [hadoop@hadoop000 hadoop-2.8.1] $find. /-name "* example*". / lib/native/examples./share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.8.1-test-sources.jar./share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.8.1-sources.jar./share/hadoop / mapreduce/lib-examples./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar./share/doc/hadoop/hadoop-mapreduce-examples./share/doc/hadoop/hadoop-yarn/hadoop-yarn-common/apidocs/org/apache/hadoop/yarn/webapp/example./share/doc/hadoop/hadoop-auth-examples./share/doc/hadoop/api/org/apache/hadoop/examples./share/doc/hadoop/api/org/apache/hadoop/security/authentication / examples./etc/hadoop/ssl-server.xml.example./etc/hadoop/ssl-client.xml.example [hadoop@hadoop000 hadoop-2.8.1] $bin/hadoop jar. / share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar pi 5104. Result interpretation
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 262
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.