Shulou(Shulou.com)06/02 Report--

This article mainly explains "flink1.12 how to read kafka data through kerberos authentication", the content of the article is simple and clear, easy to learn and understand, the following please follow the editor's ideas slowly in depth, together to study and learn "flink1.12 how to read kafka data through kerberos authentication" bar!

Description

Generally speaking, we seldom get kerberos authentication when using kafka. It is relatively easy to consume kafka data through flink, and it is generally easy to find out.

But if kafka has kerberos authentication, it is relatively troublesome, combined with the official website to explain.

Official document

Https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/datastream/kafka/

It mainly explains the need to configure flink-conf.yml and the configuration of kafka.

Configure it yourself

There are three files involved: user.keytab, jaas.conf, and krb5.conf. After configuring this configuration file, you can set the properties of kafka.

The attributes of kafka are:

Props.put ("security.protocol", "SASL_PLAINTEXT")

Props.put ("sasl.mechanism", "GSSAPI")

Props.put ("sasl.kerberos.service.name", "kafka")

With the above configuration, flink can submit tasks for kafka consumption.

Thank you for your reading, the above is the content of "how flink1.12 reads kafka data through kerberos authentication". After the study of this article, I believe you have a deeper understanding of how flink1.12 reads kafka data through kerberos authentication, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.