Shulou(Shulou.com)12/24 Report--

On November 17, 2023, StarRocks's annual large-scale technology exchange summit StarRocks Summit 2023, sponsored by the StarRocks community and sponsored by Jingzhou Technology, was successfully held in Shanghai.

With the theme of "extremely rapid evolution and integration of new students", more than 40 sharing lectures were held throughout the day. Big data experts from Ping an Bank, China Resources, Tencent Games, Aliyun, Yili, Midea, JD.com and other leading enterprises explained in detail the latest technology and best practices analyzed by big data around data evolution, demand evolution and technological evolution. It presents a wonderful technical feast for big data's analysis industry.

The summit attracted hundreds of corporate user representatives and developers to listen to the exchange, and tens of thousands of data analysis enthusiasts and practitioners attended the meeting online and watched the live broadcast of the summit through a variety of channels.

New face: the lineup of StarRocks big users is growing

This is the third annual technology exchange summit held by StarRocks, which continues the high profile of the past, with an all-star lineup of corporate user representatives, all at the head of their industry, and with extensive social awareness and influence.

Among them, there are not only the "old faces" of the Internet, such as Tencent, Ali, and JD.com, who shared their experiences at last year's summit, but also many new faces from industries such as Yili, Ping an Bank, and Mango TV, which sent representatives to the lecture for the first time.

Gathered at the summit, the picture shows Cui Yuming, director of Tencent Games's public data platform, giving a sharing speech.

As a technology-leading open source OLAP database product, StarRocks has always been favored by large users. With the accelerated penetration of StarRocks into various industries, the lineup of large users is also expanding. So far, more than 300 enterprises with a market capitalization of 1 billion US dollars have used StarRocks.

Under the demonstration and drive of large users, the user scale of small and medium-sized enterprises is also growing rapidly, and the number of StarRocks community users has exceeded 10,000, and still maintains a trend of rapid growth.

In addition, according to the usage revealed by the speakers at the summit, the scale of user deployment of StarRocks is also growing rapidly.

From the perspective of application scenarios, the scenes shared by guests include marketing, user portraits, self-help analysis, report experience upgrade, etc., basically covering all the classic application scenarios of the current real-time warehouse technology.

The picture shows Sun Wenxian, CEO of Jingzhou Technology, sharing it.

Sun Wen, CEO of Jingzhou Technology, said that the StarRocks open source community provides a fertile soil for the birth of the winning scenario, and various industries and needs collide and blend in the community, resulting in a winning scene of StarRocks.

According to Sun Wenxian, Jingzhou Technology's enterprise-level products based on StarRocks have experienced nearly 100 POC times in the whole year, with a success rate of more than 90%.

This shows how hard the capabilities of StarRocks products are, which can explain why more and more users are choosing StarRocks.

New Paradigm: StarRocks leads the trend of Integration of Lake and Cang

StarRocks TSC Member and Zhang Youdong, CTO of Jingzhou Technology, comprehensively analyzed the new paradigm of Hucang.

This summit has set up a main forum and four sub-forums. In addition to the practice-based experience sharing of enterprise user representatives, the functional interpretation of developer representatives is also wonderful.

In the past year, StarRocks released three blockbuster versions 2.5,3.0,3.1 successively. Among them, the deposit separation architecture launched in version 3.0 is the first in the open source industry and has caused great repercussions in the industry.

According to Zhang Youdong, CTO of StarRocks TSC Member and Jingzhou Technology, after upgrading to the storage and computing separation architecture, the storage cost of users can be reduced by 80%, while computing nodes can improve computing availability through rapid flexibility and cross-availability zone deployment because of statelessness, and computing resources can be physically isolated and scalable independently as needed.

By version 3.1, when Local cache is enabled, the performance under the accounting separation architecture is close to the level of local storage.

At the same time, the lake warehouse analysis capability of StarRocks is very complete, which not only supports catalog such as internal, Data lake, JDBC, ES, but also supports joint analysis across data sources.

In addition, the capability of the primary key model has been continuously improved over the past year, supporting both full-memory and persistent indexes, as well as the capabilities of partial update and conditional update. In terms of performance, a column-by-column update mode is introduced for batch update scenarios, and the performance is more than 10 times higher than that of row-by-row updates.

Zhang Youdong said that the trend of data evolution in the future is the integration of lakes and warehouses, and users do not need to pay attention to building lakes or warehouses. Whether it is building a data lake or building a data warehouse, the ultimate goal of enterprises is to solve data analysis problems with low cost and high efficiency. After having a series of heavyweight features such as deposit and calculation separation, lake warehouse analysis, materialized view and so on, StarRocks has realized the upgrade to Lakehouse engine. With the help of StarRocks, it can have the advantages of both data lake and database warehouse.

At present, dozens of enterprises are practicing the new paradigm based on StarRocks, and have achieved very good business results.

Among them, mango TV uses StarRocks storage and calculation separation as a unified Lakehouse, and all data is imported into StarRocks for unified management; Wechat near real-time data is written to Iceberg for direct analysis through Iceberg; Ctrip data is uniformly stored in Hive, and StarRocks is used to query acceleration reports directly.

New Future: the evolutionary story of StarRocks continues

According to Zhang Youdong, in the future, StarRocks will continue to move towards cloud native direction, promote the further simplification of real-time analysis links, and help enterprises discover data value at low cost and high efficiency through the operation mode of ETL on lakehouse,all in one.

It is worth mentioning that the StarRocks community is jointly built by Jingzhou Technology and Internet companies such as Aliyun, Tencent, Xiaohongshu, Didi and so on. Many feature, including global dictionary function, synchronous materialized view enhancement, Paimon Catalog and so on, are contributed by Internet big companies. In the future, they are destined to continue to absorb inspiration and help from the production environment of large factories, bringing more surprises to the industry.

The summit has set up a special booth area for ecological manufacturers, and the picture shows participants actively consulting in front of the Jingzhou science and technology booth.

At the same time, the business ecology formed around StarRocks is becoming more and more perfect, and the business team represented by Jingzhou Technology continues to improve the ease of use and stability of products, landing product capabilities into a complex demand environment and creating greater value.

With the spread of the wonderful content of this summit, it is believed that more and more enterprises will be inspired to use the cutting-edge technology in the field of OLAP to upgrade and evolve their business scenarios.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.