Shulou(Shulou.com)06/01 Report--

This article mainly introduces "how to debug mapreduce programs in eclipse debug". In daily operation, I believe many people have doubts about how to debug mapreduce programs in eclipse debug. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the doubts about "how to debug mapreduce programs in eclipse debug". Next, please follow the editor to study!

1. Copy the mapred-site.xml file into the project

Mapreduce.framework.name yarn mapred.child.java.opts-Xmx800m-Xdebug-Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=8000 mapreduce.jobtracker.staging.root.dir / tmp yarn.app.mapreduce.am.staging-dir / tmp mapreduce.framework.name local mapreduce.jobtracker.address local mapred.job.trackerlocal

2. Add the local mapred-site.xml configuration to the project, read the configuration file from the local project and run it, and debug in reduce.

Job job = new Job (conf, "word count"); conf.addResource ("classpath:/Hadoop01/mapred-site.xml"); conf.set ("fs.defaultFS", "hdfs://192.168.1.10:9008"); conf.set ("mapreduce.framework.name", "yarn"); conf.set ("yarn.resourcemanager.address", "192.168.1.10 word count") Conf.set ("mapred.remote.os", "Linux"); conf.set ("hadoop.job.ugi", "hadoop,hadoop"); at this point, the study on "how to debug mapreduce programs by eclipse debug" is over, hoping to solve everyone's doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.