Shulou(Shulou.com)05/31 Report--

This article mainly introduces "how to develop mapreduce under windows". In daily operation, I believe many people have doubts about how to develop mapreduce under windows. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the doubts of "how to develop mapreduce under windows". Next, please follow the editor to study!

1. First, right-click in map/reduce locations to new a hadoop location, as shown in the following figure is created. If it is the first time, there will be no myhadoop.

2. Configuration

The location name in this is a random name. Host is the host ip of fs.defaultFS 's url in the hadoop configuration file core-site.xml. The port on the right is the port number of fs.defaultFS 's url. User name is the user name of the linux system using hadoop.

3. If successful, you can expand the directory on the left so that you can see the files on hdfs. If you can't see the directory, see if your hadoop cluster is started. Don't make such a low-level mistake.

4. Try whether you can delete the files inside. If not, permission may be involved. Modify the cluster configuration file hdfs-site.xml.

Dfs.permissions false

5. If you create a new mapreduce project, you will automatically import all the jar packages you need, and then write a wordcount Mini Program. You will not write it here. Right-click on this class and select run as configration.

Configure the mainclass point tab Arguments

Fill in the running parameters. The first is the input directory and the second is the output directory. After configuration, run as hadoop can see the ouput folder under the left directory tree.

At this point, the study on "how to develop mapreduce under windows" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.