In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-04-03 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >
Share
Shulou(Shulou.com)05/31 Report--
This article mainly shows you "what are the core concepts of flume NG", which is easy to understand and clear. I hope it can help you solve your doubts. Let the editor lead you to study and learn this article "what are the core concepts of flume NG?"
Core concepts of flume NG
Event
Client
Agent
Source
Channel
Sink
A.Event is the basic unit of Flume data transmission.
B.Flume transmits data from the source to the final destination (such as HDFS) in the form of events.
The c.Event may consist of an optional header and a byte array containing data.
D.Client is a process that wraps the original log into Events and sends them to one or more Agent entities.
E.Client is not required in the topology of Flume, and its purpose is to decouple Flume from the data source system.
f. An Agent contains Source, Channel, Sink, and other components.
G.Agent uses these components to transfer Events from one node to another or to the ultimate destination (file system: such as HDFS).
H.Agent is the most important part of the Flume stream.
I.Flume provides configuration, life cycle management, and monitoring support for these components.
These are all the contents of the article "what are the Core Concepts of flume NG". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.