Shulou(Shulou.com)06/03 Report--

What this article shares to you is the detailed tutorial of installing and configuring kafka in the Linux environment. I believe most people do not know how to install it. In order to let you learn, I have summarized the following contents.

Precondition

Zookeeper must be installed. Linux install zookeeper

Kafka official source

Kafka official website download page

Download the kafka installation package # version: kafka_2.11-2.3.0.tgzwget http://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.3.0/kafka_2.11-2.3.0.tgz

Extract the installation package tar-zxvf kafka_2.11-2.3.0.tgzcp kafka_2.11-2.3.0 / usr/local/kafka

Start the kafka service cd / usr/local/kafka/bin# startup command: the daemon starts. / kafka-server-start.sh-daemon.. / config/server.properties

Note: an error may be reported here, because by default, the default memory of kafka is 1 gigabyte, and if you don't have so much memory available, it will fail to start. The error is as follows:

Java Hotspot (TM) 64-Bit Server VM warning: INFO: os::commit_memory (0x00000000c5330000, 986513408, 0) failed; error='Cannot allocate memory' (errno=12) # # There is insufficient memory for the Java Runtime Environment to continue.# Native memory allocation (malloc) failed to allocate 986513408 bytes for committing reserved memory.# An error report file with more information is saved as:# hs_err_pid5535.log

Solution:

Modify the startup script: kafka-server-start.shvim kafka-server-start.sh

The content of the setting is set according to your own situation.

Create a chart named test for topic#, with only one copy, and a partition kafka-topics.sh-- create-- zookeeper localhost:2181-- replication-factor 1-- partitions 1-- topic chart# to view the topickafka-topics.sh-list-zookeeper localhost:2181 of kafka

Production and consumption testing # start the production side. / kafka-console-producer.sh-- broker-list localhost:9092-- topic chart# start the consumer side. / kafka-console-consumer.sh-- bootstrap-server localhost:9092-- topic chart-- from-beginning

After reading this article, have you learned to install and configure kafka in the Linux environment? If you want to learn more skills or want to know more about it, you are welcome to follow the industry information channel. Thank you for reading.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.