Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

What is the MapReduce1 architecture design method?

2025-02-27 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Development >

Share

Shulou(Shulou.com)06/02 Report--

This article focuses on "what is the design method of MapReduce1 architecture". Interested friends may wish to have a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn "what is the MapReduce1 architecture design method"?

MapReduces1 architecture design

Hadoop1.x MR1 (Computing + Resource Job scheduling)

There are two processes, JobTracker and TaskTracker (map task+reduce task), which belong to the master-slave architecture.

JobTracker:

Monitor resources and job scheduling, monitor the health status of all TaskTracker and job through heartbeat

Tell the scheduler to trace the task usage resource usage

TaskTracker:

Responsible for receiving and executing commands sent by JobTracker

Report node resource usage and tasks to JobTracker

TaskScheduler:

Task Scheduler (FIFO principle, first-in, first-out, first-hand execution according to job priority time)

At this point, I believe you have a deeper understanding of "what is the method of MapReduce1 architecture design?" you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Development

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report