Shulou(Shulou.com)06/01 Report--

This article mainly shows you "how to install Flink in the Linux system", the content is easy to understand, clear, hope to help you solve doubts, the following let the editor lead you to study and learn "how to install Flink in the Linux system" this article.

Introduction to Flink: in the current era of the proliferation of Internet users, devices, services, etc., the amount of data generated is no longer the same. A large amount of data will be generated in a variety of business scenarios, and how to deal with these data effectively is a problem that many enterprises need to consider. Frameworks such as Map Reduce,Storm,Spark that we are familiar with in the past may not be able to fully meet the needs of users in some scenarios, or the cost of implementing the requirements, no matter the amount of code or the complexity of the architecture may not be able to meet the expected requirements. The emergence of new scenarios promotes the production of new technologies, and Flink provides a new choice for the processing of real-time streams. Apache Flink is a distributed processing framework that is more active in the community in recent years. Coupled with the promotion of Ali in China, it is believed that it will have more advantages in the future competition. The background of Flink is not introduced too much, those who are interested can Google it. Flink's relatively simple programming model, coupled with its high throughput, low latency, high performance and support for exactly-once semantics, makes it outstanding in industrial production. I believe that as many blog materials have written, "Flink will become the mainstream data processing framework within the enterprise, and eventually become the next generation of big data processing standard."

Linux system installation Flink specific steps: first, download Flink (2 ways for simplicity I use the second one. )

1. Download Flink manually

1.1.The official website download: https://flink.apache.org/downloads.html#apache-flink-172

1.2. Download the compressed package and upload the directory created by the server (abbreviated).

2. Download Flink automatically

Create a directory: mkdir / root/kingyifan/flink download Flink: wget mirrors.hust.edu.cn/apache/flink/flink-1.7.2/flink-1.7.2-bin-hadoop24-scala_2.11.tgz (version number please visit the website to check) specific version number please refer to: http://mirrors.hust.edu.cn/apache/flink/

2. Decompress the compressed package

Command: tar-zxvf flink-1.7.2-bin-hadoop24-scala_2.11.tgz decompressed successfully:

3. Start Flink

Go to the bin directory: cd / root/kingyifan/flink/flink-1.7.2/bin/ start flink:./start-cluster.sh to check whether the startup is successful:

Command: jps III, centos6 Open flink default port (8081) modify iptables

Add:-An INPUT-m state-- state NEW-m tcp-p tcp-- dport 8081-j ACCEPT restart firewall: service iptables restart

4. Visit the ui interface: 192.168.241.134pur8081

5. Test 5.1. Xsheel replicates three sessions first:

Open the first session:

Start a terminal (port at will): nc-lk 8888 to open a second session:

Enter the bin directory: cd / root/kingyifan/flink/flink-1.7.2/ command: bin/flink run examples/streaming/SocketWindowWordCount.jar-- port 8888 to open the third session:

Go to the log directory: cd / root/kingyifan/flink/flink-1.7.2/log command: tail-f flink-root-taskexecutor-5-localhost.localdomain.out (not necessarily this log file) log directory:

Enter whatever you want in the first session

Look at the third content:

Is there a doubt about what is the one after that?

How many times did he show up in a few seconds? let's just lose a few 1s for a test.

I found that he had almost figured it out.

We can also take a look at Running Jobs.

The above is all the contents of the article "how to install Flink in Linux system". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.