Shulou(Shulou.com)06/03 Report--

(1) the data generated by the producer is partitioned by using custom key as hashcode.

Topic can be physically divided into one or more Partition in 1.Kafka

Each partition physically corresponds to a folder, named in the "topicName_partitionIndex" manner

All messages (.log) and index (.index) files for this partition are stored under the folder

# for example, Topic:test0320 uses 3 partitions and 2 replicas 186 187 188-test0320-0 test0320-0 test0320-1test0320-2 test0320-1test0320-2

two。 When producing data, producers can customize Key rules for each message, so that when messages are sent to broker, they will choose which partition to store in according to the partition rules.

3. Partition rules are classes that implement the kafka.producer.Partitioner interface

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.