Shulou(Shulou.com)06/01 Report--

This article will explain in detail about the installation and use of Kafka 1.0.0 and what the command is, the content of the article is of high quality, so the editor will share it with you for reference. I hope you will have a certain understanding of the relevant knowledge after reading this article.

0. Three machines data133,data135,data1361. Modify the configuration file server.properties broker.id=1 # globally unique log.dirs=/data/kafka/log # kafka directory zookeeper.connect=data135:2181,data133:2181,data136:2181 port=9092 host.name=data136 where the data is stored and distribute it to the other two machines data133:broker.id=2 host.name=data133 data135:broker.id=2 host.name=data135 2. Backstage 2. Start nohup. / kafka-server-start.sh.. / config/server.properties & 3 in the kafka server bin directory in the background. Create topic. / kafka-topics.sh-- create-- topic "test1"-partitions 5-- replication-factor 1-- zookeeper data1334. Through shell script production consumption production:. / kafka-console-producer.sh-topic test-- broker-list data133:9092,data135:9092,data136:9092 consumption:. / kafka-console-consumer.sh-- topic test-- from-beginning-- bootstrap-server data133:90925. Show all topic. / kafka-topics.sh-- list-zookeeper bigdata03-flume integration kafka Configuration file kafka-dest.conf# Name the components on this agenta1.sources=sr1a1.channels=ch2a1.sinks=si1# Describe/configure the sourcea1.sources.sr1.type=execa1.sources.sr1.command=tail-F / home/ch.loga1.sources.sr1.batchSize=50# Describe the sinka1.sinks.si1.type=org.apache.flume.sink.kafka.KafkaSinka1.sinks.si1.kafka.bootstrap.servers=bigdata01:9092,bigdata02:9092 for flume Bigdata03:9092a1.sinks.si1.kafka.topic=test7a1.sinks.si1.flumeBatchSize=100a1.sinks.si1.kafka.producer.acks=1a1.sinks.si1.kafka.producer.partitioner.class=org.apache.kafka.clients.producer.internals.DefaultPartitioner# Use a channel which buffers events in memorya1.channels.ch2.type = memorya1.channels.ch2.capacity = 1000000a1.channels.ch2.transactionCapacity = 1000a1.sources.sr1.channels=ch2a1.sinks.si1.channel=ch2#the command to start an agent#bin/flume-ng agent-n A1-c conf-f conf/ So much for fkafka-dest.conf about the installation and use of Kafka 1.0.0 and what the commands are. I hope the above content can be of some help to you and learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.