Shulou(Shulou.com)06/01 Report--

User pain points:

Hundreds of terabytes of historical business data, it takes time and effort to import it at one time.

There are many kinds of ETL tools available, but the results are not ideal.

Fast data query and complex join operation scenarios, poor query performance

The business is changing rapidly and needs to provide scalability

Automatic failover and cluster monitoring alarm functions are required

Need to cover 27 provinces to deploy operation and maintenance support.

Solution:

Deploy GreatDB Cluster distributed cluster and customize data flow access scheme based on business

Results presentation:

About 250 x86 servers in 27 provinces across China set up row transaction database clusters

Stores hundreds of TB data from dozens of business systems upstream, with a data compression ratio as high as 7:1

Integrate the cluster monitoring and management platform based on zabbix and expand the cluster as needed

Highly compatible with upstream and downstream incremental synchronization tools and ETL tools

Real-time capture synchronization of hundreds of thousands of tables in dozens of source systems

The cluster provides business standard SQL data query access.

Through cross-node join function to meet the business lightweight AP requirements, through distributed parallel query to meet the needs of mass extraction of ETL data.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.