Shulou(Shulou.com)06/01 Report--

This article introduces you how to build kafka-manager monitoring tools, the content is very detailed, interested friends can refer to, hope to be helpful to you.

1. Download sbt

Http://www.scala-sbt.org/download.html

[root@sht-sgmhadoopnn-01 app] # rz

Rz waiting to receive.

Starting zmodem transfer. Press Ctrl+C to cancel.

Transferring sbt-0.13.13.tgz...

1025 KB 1025 KB/sec 00:00:01 0 Errors

two。 Decompression

[root@sht-sgmhadoopnn-01 app] # tar-zxvf sbt-0.13.13.tgz

Sbt-launcher-packaging-0.13.13/

Sbt-launcher-packaging-0.13.13/conf/

Sbt-launcher-packaging-0.13.13/conf/sbtconfig.txt

Sbt-launcher-packaging-0.13.13/conf/sbtopts

Sbt-launcher-packaging-0.13.13/bin/

Sbt-launcher-packaging-0.13.13/bin/sbt.bat

Sbt-launcher-packaging-0.13.13/bin/sbt

Sbt-launcher-packaging-0.13.13/bin/sbt-launch.jar

Sbt-launcher-packaging-0.13.13/bin/sbt-launch-lib.bash

[root@sht-sgmhadoopnn-01 app] # mv sbt-launcher-packaging-0.13.13 sbt

3. Add script Fil

[root@sht-sgmhadoopnn-01 bin] # vi sbt

#! / usr/bin/env bash

BT_OPTS= "- Xms512M-Xmx1536M-Xss1M-XX:+CMSClassUnloadingEnabled-XX:MaxPermSize=256M"

Java $SBT_OPTS-jar / root/learnproject/app/sbt/bin/sbt-launch.jar "$@"

4. Modify permissions and environment variables

[root@sht-sgmhadoopnn-01 bin] # chmod uplix sbt

[root@sht-sgmhadoopnn-01 bin] # vi / etc/profile

Export SBT_HOME=/root/learnproject/app/sbt

Export PATH=$SBT_HOME/bin:$SPARK_HOME/bin:$SCALA_HOME/bin:$HADOOP_HOME/bin:$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH

"/ etc/profile" 94L, 2265C written

[root@sht-sgmhadoopnn-01 bin] # source / etc/profile

5. test

/ * when executing for the first time, some packages will be downloaded before they can be used normally. To ensure that they are connected to the Internet, the following will be displayed after successful installation * /

[root@sht-sgmhadoopnn-01 bin] # sbt sbt-version

[info] Set current project to bin (in build file:/root/learnproject/app/sbt/bin/)

[info] 0.13.13

[info] Set current project to bin (in build file:/root/learnproject/app/sbt/bin/)

[info] 0.13.13

[root@sht-sgmhadoopnn-01 bin] #

-

Because jdk1.8 is required for kafka-manager compilation

1. Install jdk1.8

[root@sht-sgmhadoopnn-01 app] # cd / usr/java

[root@sht-sgmhadoopnn-01 java] # ll

Total 4

Drwxr-xr-x 8 root root 4096 Nov 17 2015 jdk1.7.0_67-cloudera

[root@sht-sgmhadoopnn-01 java] # rz

Rz waiting to receive.

Starting zmodem transfer. Press Ctrl+C to cancel.

Transferring jdk-8u102-linux-x64.tar.gz...

177183 KB 425 KB/sec 00:06:56 0 Errors

[root@sht-sgmhadoopnn-01 java] # ll

Total 177192

Drwxr-xr-x 8 root root 4096 Nov 17 2015 jdk1.7.0_67-cloudera

-rw-r--r-- 1 root root 181435897 Jun 28 00:02 jdk-8u102-linux-x64.tar.gz

[root@sht-sgmhadoopnn-01 java] # tar-xzvf jdk-8u102-linux-x64.tar.gz

[root@sht-sgmhadoopnn-01 java] # vi / etc/profile

Export PATH=/usr/java/jdk1.8.0_102/bin:$SBT_HOME/bin:$SPARK_HOME/bin:$SCALA_HOME/bin:$HADOOP_HOME/bin:$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH

[root@sht-sgmhadoopnn-01 java] # source / etc/profile

-

Https://github.com/yahoo/kafka-manager

Requirements:

Kafka 0.8.1.1 or 0.8.2.* or 0.9.0.*

Java 8 +

1. Download, use sbt to compile

[root@sht-sgmhadoopnn-01 ~] # cd / root/learnproject/compilesoft

[root@sht-sgmhadoopnn-01 compilesoft] # git clone https://github.com/yahoo/kafka-manager.git

[root@sht-sgmhadoopnn-01 compilesoft] # cd kafka-manager/

[root@sht-sgmhadoopnn-01 kafka-manager] # sbt clean dist

[info] Your package is ready in / root/learnproject/compilesoft/kafka-manager/target/universal/kafka-manager-1.3.2.1.zip

[info]

[success] Total time: 126 s, completed Dec 26, 2016 2:44:17 PM

two。 Decompression

[root@sht-sgmhadoopnn-01 kafka-manager] # mv / root/learnproject/compilesoft/kafka-manager/target/universal/kafka-manager-1.3.2.1.zip / root/learnproject/app/

[root@sht-sgmhadoopnn-01 kafka-manager] # cd.. /

[root@sht-sgmhadoopnn-01 app] # unzip kafka-manager-1.3.2.1.zip

[root@sht-sgmhadoopnn-01 app] # cd kafka-manager-1.3.2.1/conf

[root@sht-sgmhadoopnn-01 conf] # vi application.conf

Kafka-manager.zkhosts= "172.16.101.58:2181172.16.101.59:2181172.16.101.60:2181/kafka"

3. Background operation

[root@sht-sgmhadoopnn-01 kafka-manager-1.3.2.1] # nohup. / bin/kafka-manager-Dconfig.file=./conf/application.conf-Dhttp.port=9999-java-home / usr/java/jdk1.8.0_102 > kafka-manager.log 2 > & 1 &

Http://172.16.101.55:9999/

4. Add Cluster

A.Add Cluster

Cluster Name: onlinelog_analysis_kafkacluster

Cluster Zookeeper Hosts: 172.16.101.58:2181172.16.101.59:2181172.16.101.60:2181/kafka

Check Enable JMX Polling (Set JMX_PORT env variable before starting kafka server)

Then check the indicator information below (see screenshot)

Click the Save button

B.Brokers

On how to build kafka-manager monitoring tools is shared here, I hope that the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.