Shulou(Shulou.com)06/03 Report--

Report is an indispensable module of many web application systems, and it is still the basic function of most BI projects. With the advent of the data age, data sources are becoming more and more diverse (text,excel,monogdb,redis,es …) It brings a challenge to the report data preparation, the traditional practice is to first put the data out of the database into the database, and then use the computing power of the database (write SQL or stored procedures) to prepare the data for the report. Due to the dependence on pre-import, the real-time performance of the report can not be guaranteed, and the report development process is also lengthened. With the increasing demand for the report, the database is becoming more and more bloated, and the management cost is increasing.

However, if you directly use these out-of-database data for report development, it is always time-consuming and laborious, and the performance of the final report is often not good enough. To investigate the reason, programmers who are familiar with report development all know that report tools only provide several simple capabilities for calculating this kind of data outside the library. When the computing requirements are complex, they need to be extended to the outside of the report tool and implemented in a user-defined way. This kind of calculation is usually hard-coded in high-level language (Java,.net) and requires strong data programming experience, which is often beyond the ability of ordinary report developers. Development implemented in high-level languages is expensive and non-reusable.

Even if the data is in a database, calculating complex reports often requires advanced window functions or stored procedures that are easy to use. These are open source databases (mysql,hive … ), the commercial database is much better, but it is not easy to implement. You usually need to use the advanced extension of SQL, and each database vendor has different SQL extensions, which requires proficiency in some kind of database master. It is not easy to be familiar with all kinds of databases and become a SQL master. How to make ordinary report developers solve this kind of problem easily in the same way? In addition, when the stored procedure is coupled with the database, the extensive use of the stored procedure will bring huge overhead to the database operation, and the maintenance is also very troublesome.

If there can be a computing engine, which has the same computing power as the database, does not have to import data, directly calculates data from various sources, provides general advanced window functions and stored procedures, and independently prepares data for the report, solve the above problems, it will greatly improve the development progress and application effect of the report.

The above is the original intention of the design of the integrated version of the aggregator. below, by introducing its application structure, an example is given to illustrate its ease of use, combined with open source report tools to show the practical value of the product in the report application scenario.

For more exciting content, please refer to the documentation:

A general tool for efficient report development

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.