Shulou(Shulou.com)06/01 Report--

Editor to share with you what are the improvements of Apache Flink 1.6.0, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

The major updates for Apache Flink 1.6.0 include the following:

Flink's state support is one of the key features that make Flink so common and powerful in implementing various use cases. To make it easier to use, the community has added native support for TTL (FLINK-9510, FLINK-9938), which allows you to clean up the state after it expires. In Flink 1.6.0, the timer state can now be detached from the system and stored directly in RocksDB (FLINK-9485). Finally, the deletion of timers is also significantly improved (FLINK-9423).

In Flink 1.5.0, we redesigned the Flink distributed architecture to increase the flexibility of resources and support for different deployment scenarios, while further improving the integration of containers. In Flink 1.6.0, some of the unfinished work has been improved: all external communications (including job submissions) are now based on HTTP/REST (FLINK-9280), which greatly simplifies the container setup (FLINK-9280). Flink 1.6.0 also introduces a container entry point (container entrypoint), which can easily boot containerized job clusters (FLINK-9488).

Streaming SQL is one of the most potential features because it makes Flink easier to access. In Apache Flink 1.6.0, the community further improved SQL CLI (FLINK-8863) to make it easy to execute streaming and batch queries against a large number of data sources (FLINK-8861). In addition, complete Avro support can seamlessly read any Avro data (FLINK-9444). Finally, the community enhanced Flink's CEP library (FLINK-9418).

In the latest version of Flink, we have added a new StreamingFileSink (FLINK-9750) that uses BucketingSink as a standard file receiver. At the same time, support for ElasticSearch 6.x (FLINK-7386) has been added and AvroDeserializationSchemas has been modified to make it easier for us to ingest Avro data (FLINK-9338).

Other new features and enhancements

Support status TTL (FLINK-9510, FLINK-9938)

RocksDB-based Extensible timer (FLINK-9485)

Delete timer faster (FLINK-9423), significantly improve the deletion of timer.

Added job cluster container entry point (FLINK-9488): Flink 1.6.0 also introduced container entry point (container entrypoint), which can easily boot containerized job cluster (FLINK-9488).

Fully RESTified Job Submission (FLINK-9280)

SQL client CLI supports user-defined functions (FLINK-8863)

SQL client CLI supports batch query (FLINK-8861)

SQL client CLI supports INSERT INTO statements (FLINK-8858)

Unified Table receiver (Table Sinks) and format (FLINK-8866,FLINK-8558)

New Kafka Table Sink (FLINK-9846)

Full SQL Avro Support (FLINK-9444)

Improve the expression ability of SQL and Table API (FLINK-5878, FLINK-8688, FLINK-6810)

These are all the contents of this article entitled "what are the improvements in Apache Flink 1.6.0?" Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.