Shulou(Shulou.com)06/03 Report--

The three major component functions of hadoop:

Common:

Tools, foundations, for services

MapReduce:

The processing of massive data

Distributed system

Thought

divide and rule

Big data set is divided into small data sets.

Each data set, dedicated logic business processing map

Merge statistics results reduce

HDFS:

Store huge amounts of data

Distributed system

Security.

Copy data

Data is stored in the form of block

NameNode

Memory

Local disk

Fsp_w_picpath: mirror fil

Edites: Editing log

YARN:

Distributed resource management framework

Manage the resources of the entire cluster (memory, cpu cores)

Allocate the resources of the scheduling cluster

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.