Shulou(Shulou.com)06/01 Report--

This article is about how CDH integrates kafka. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Add kafka (all packages are placed on the cm host)

1. Download kafka package http://archive.cloudera.com/kafka/parcels/latest/

Put the package in the parcel-repo directory

two。 Download csd package http://archive.cloudera.com/csds/kafka/

Put it in the csd directory

3. Assign kafka packages and activate

Note: if the progress card is "decompressed", go straight back in and you will see "active".

4 add kafka role

The default option is fine.

Start error reporting Java heap space after installation (as shown below)

Need to modify Java memory, the default is 50m, this is very strange, there is no prompt to set memory during installation, as a result, it cannot be started after the installation.

Enter kafka and select "configuration"

Change the Java Heap Size to 1G (change the parameters according to the server configuration)

Finally, save it and restart kafka on the console.

Thank you for reading! This is the end of the article on "how to integrate CDH with kafka". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.