Shulou(Shulou.com)06/01 Report--

This article introduces you how to thoroughly figure out the differences between different versions of kafka, the content is very detailed, interested friends can refer to, I hope it can be helpful to you.

I have been using kafka for a long time, and I don't pay special attention to the version rules of kafka and what optimizations have been made in the upgrades of various major versions. The editor is going to do a more detailed arrangement.

1. Version naming rules

After 1.x, kafka fully enables the three-digit naming convention. In other words, the previous versions were all in this color.

0.8.2.2

0.9.0.1

0.10.0.0

Later, after 1x, kafka fully enabled the three-digit version of the rule, as shown in the following figure

The new version rule, "large version-small version-patch version", is more in line with the mainstream.

The version of kafka we see now usually looks like this.

Kafka_2.11-2.2.0

The first part 2.11 is actually the version of scala (kafka is written by scala), and the last three are the real kafka version.

2. Several major milestones, version 0.8.2

To improve throughput, producer sends messages to broker nodes in asynchronous batches.

The consumption offset location offset of consumer has been changed from being saved in zookeeper to saved in kafka itself.

Version 0.9

Add security-related features, and client connection kafka can be verified using ssl or sasl.

Add kafka connect module

New consumer api

Version 1.0.0

Support for java 9

Enhanced stream api

A threading protocol is introduced to facilitate upgrade

Version 2.0.0

Minimum support for java8

Abandoning many scala-related dependencies, java becomes the mainstream

2.2.0

The default consumer group id has been changed from "" to null.

Bin\ kafka-topic.sh supports specifying-- bootstrap-server instead of the original-- zookeeper.

3. About the client version

Kafka supports client api in multiple languages, and I only focus on java clients. In the project of maven, we usually introduce the kafka client like this.

Org.apache.kafka

Kafka_2.11

0.10.2.0

This introduces two dependent jar, namely

Kafka-clients-0.10.2.0.jar

Kafka_2.11-0.10.2.0.jar

The former is the officially recommended java client, while the latter is the scala client. The invocation method is different. If you decide not to use scala api, you can also include only the java version of the client in this way.

Org.apache.kafka

Kafka-clients

0.10.2.0

One principle is to try to keep the client version consistent with the server version running on the server.

On how to thoroughly understand the differences between the various versions of kafka to share here, I hope that the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.