Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Introduction of Hadoop output parameter information

2025-01-17 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/01 Report--

This article mainly explains "introduction of Hadoop output parameter information". Interested friends may wish to have a look at it. The method introduced in this paper is simple, fast and practical. Next let the editor to take you to learn "Hadoop output parameter information introduction" bar!

Counters:19

FileOutputFormatCounters

Number of bytes output from BytesWritten=19 / / reduce to hdfs

FileSystemCounters

FILE_BYTES_READ=481

HDFS_BYTES_READ=38

FILE_BYTES_WRITTEN=81316

HDFS_BYTES_WRITTEN=19

FileInputFormatCounters

Number of bytes read from hdfs by BytesRead=19 / / map

Map-ReduceFramework

Mapoutputmaterializedbytes=49

Number of rows of records read in by Mapinputrecords=2 / / map

Reduceshufflebytes=0

SpilledRecords=8

Mapoutputbytes=35

Totalcommittedheapusage (bytes) = 266469376

SPLIT_RAW_BYTES=105

Combineinputrecords=0

The number of rows of records received by Reduceinputrecords=4 / / reduce from the map side

The number of key received by the Reduceinputgroups=3 / / reduce function, that is, the number of K2 after the merger

Combineoutputrecords=0

Number of rows of records output from Reduceoutputrecords=3 / / reduce

Number of rows of records output from Mapoutputrecords=4 / / map

At this point, I believe that everyone on the "Hadoop output parameter information introduction" have a deeper understanding, might as well to the actual operation of it! Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report