Shulou(Shulou.com)06/01 Report--

This article introduces the relevant knowledge of "how to realize hadoop reduce number control". In the operation process of actual cases, many people will encounter such difficulties. Next, let Xiaobian lead you to learn how to deal with these situations! I hope you can read carefully and learn something!

1. Parameter changes

1.x Parameter Name 2.x Parameter Name

mapred.tasktracker.reduce.tasks.maximum mapreduce.tasktracker.reduce.tasks.maximum

mapred.reduce.tasks mapreduce.job.reduces

2. Parameter setting

2.1 mapred.tasktracker.reduce.tasks.maximum is set to the number of logical CPUs

mapred.tasktracker.reduce.tasks.maximum

8

true

2.2.1 Hadoop server-side parameter setting

mapred.reduce.tasks

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.