Shulou(Shulou.com)06/01 Report--

Today, I will talk to you about how to use CMAK, a visual Web interface management tool for Kafka. Many people may not know much about it. In order to make you understand better, the editor has summarized the following for you. I hope you can get something according to this article.

Anyone who has used KafKa clusters knows that it is really difficult for beginners to remember KafKa commands, so they generally look for management tools that can operate on the page.

Today, I'd like to introduce one of the visual Web interface management tools, which is kafka-manager, but now it has been renamed CMAK.

Brief introduction of kafka-manager Management tools

It was originally open source by Yahoo, with full-featured features and rich data. At the same time, users can perform some simple cluster management operations on the interface.

But Yahoo has changed its name to CMAK (Cluster Manager for Apache Kafka).

Features supported by CMAK

Supported featur

Manage multiple clusters

Easily check cluster status (topics, consumers, offsets, agents, replica distribution, partition distribution)

Run the preferred copy election

Use the option to generate a partition assignment to select the agent to use

Run partition reassignment (based on generated allocation)

Create a theme with an optional theme configuration (0.8.1.1 has a different configuration than 0.8.2 +)

Delete the theme (only 0.8.2 + is supported and remember to set delete.topic.enable = true in the proxy configuration)

The topic column is shown in the topic that indicates the topic marked for deletion (only 0.8.2 + is supported)

Batch generate partition assignments for multiple topics, and you can select agents to use

Run a batch of partitions that reassign multiple topics

Add a partition to an existing topic

Update the configuration of an existing theme

Optionally open JMX polling for broker level and topic level metrics

Selectively filter out consumers without ids | owners | offsets | directories in zookeeper

Let's share with you how to deploy and install this management tool.

Scope of support for CMAK management tools

Support Kafka version 0.8 or above

Java 11 +

Zookeeper must be version 3.5 +.

Some may say that there are so many requirements and involve the zookeeper version, then you can choose the older version of Kafka-manager, such as 1.3.3.23.

Ordinary users configure Java11 environment

You need to download the Java11 package in advance and extract it to the specified location.

Here I have made the following configuration:

$vim ~ / .bash_profile export JAVA_HOME=$HOME/3rd/jdk-11.0.4 export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar export PATH=$JAVA_HOME/bin:$PATH

Effective environment variable

$source ~ / .bash_profile

Verify that it works, and if it shows the path of the jdk directory you deployed, it works successfully.

$which java ~ / 3rd/jdk-11.0.4/bin/java

Ordinary users download the installation package

Official website address: https://github.com/yahoo/CMAK

Here, take version 3.0.0.5 as an example to download.

$wget https://github.com/yahoo/CMAK/releases/download/3.0.0.5/cmak-3.0.0.5.zip

Extract the installation package and enter the unzipped directory.

$unzip cmak-3.0.0.5.zip$ cd cmak-3.0.0.5

Modify the configuration file application.conf

$vim cmak-3.0.0.5/conf/application.conf

Edit the open file with the above command and configure the following two configuration items to the zookeeper address corresponding to your actual kafka cluster.

Kafka-manager.zkhosts= "kafka-manager-zookeeper:2181" cmak.zkhosts= "kafka-manager-zookeeper:2181"

Start the service

Port 9000 is used by default. If the port is occupied, you can specify the port by parameter.

$bin/cmak-Dconfig.file=conf/application.conf-Dhttp.port=9001

Effect picture

Web Home Page

Click "Add Cluster" in the figure above to enter the add Cluster wizard.

Configure Kafka cluster information to be managed

Note: if the Kafka cluster that needs to be managed and monitored has JMX_PORT enabled, you can check the extra blue option, otherwise, do not check it, just leave it unchecked by default.

Add cluster management

If there is any wrong report, it is this:

Yikes! KeeperErrorCode = Unimplemented for / kafka-manager/mutex Try again.

Then you need to upgrade zookeeper to version 3.5 +.

Successfully created cluster management

3. After the creation is successful, you can see your Kafka information.

Cluster information

Specific Topic list

Through this management tool, we can carry out Topic (theme), partition and other operations, no longer need to use the command line to call the Kafka cluster to get information, and improve our efficiency.

Add: I have been using the kafka-manager/archive/1.3.3.23.tar.gz package before, and the effect of the new version will be the same after deployment. If the kafka cluster you are deploying does not support the latest CMAK requirements, you can try downloading the 1.3.3.23.tar.gz version.

After reading the above, do you have any further understanding of how to use CMAK, a visual Web interface management tool for Kafka? If you want to know more knowledge or related content, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.