Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Example Analysis of multiple source in flume

2025-02-25 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)05/31 Report--

This article mainly shows you the "sample analysis of multiple source in flume", which is easy to understand and clear. I hope it can help you solve your doubts. Let the editor lead you to study and learn the article "sample analysis of multiple source in flume".

Agent1.channels=ch2

Agent1.sources=exec-source1 exec-source2

Agent1.sinks=hdfs-sink1

Agent1.channels.ch2.type=memory

Agent1.channels.ch2.capacity=1000

Agent1.channels.ch2.transactionCapacity=1000

Agent1.channels.ch2.keep-alive=30

Agent1.sources.exec-source1.type=exec

Agent1.sources.exec-source1.command=/usr/bin/vmstat 1

Agent1.sources.exec-source1.channels=ch2

Agent1.sources.exec-source1.threads=5

Agent1.sources.exec-source2.type=exec

Agent1.sources.exec-source2.command=tail-F / root/date.txt

Agent1.sources.exec-source2.channels=ch2

Agent1.sources.exec-source2.threads=5

Agent1.sinks.hdfs-sink1.channel=ch2

Agent1.sinks.hdfs-sink1.type=hdfs

Agent1.sinks.hdfs-sink1.hdfs.path=hdfs://slaver3:8020/root/

Agent1.sinks.hdfs-sink1.hdfs.writeFormat=Text

Agent1.sinks.hdfs-sink1.hdfs.fileType=DataStream

Agent1.sinks.hdfs-sink1.hdfs.rollInterval=2000

Agent1.sinks.hdfs-sink1.hdfs.rollSize=2000

Agent1.sinks.hdfs-sink1.hdfs.rollCount=20

Agent1.sinks.hdfs-sink1.hdfs.batchSize=1000

Agent1.sinks.hdfs-sink1.hdfs.txnEventMax=1000

Agent1.sinks.hdfs-sink1.hdfs.callTimeout=60000

Agent1.sinks.hdfs-sink1.hdfs.appendTimeout=60000

Agent1.sinks.hdfs-sink1.hdfs.filePrefix=%Y-%m-%d

Agent1.sinks.hdfs-sink1.hdfs.useLocalTimeStamp=true

The above is all the content of the article "sample Analysis of multiple source in flume". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report