Shulou(Shulou.com)06/03 Report--

The process of data analysis includes: data modeling, big data processing, alarm and trigger, report and so on.

From the point of view of the real-time requirements of data processing, big data analysis can be divided into batch and streaming data processing methods. Batch processing is mainly suitable for analytical applications with low real-time requirements, while streaming processing is mainly suitable for online analysis applications with high real-time requirements.

Batch processing is mainly suitable for the analysis and processing of large-scale offline data, such as enterprise periodic statistical reports, which can be sampled by batch processing. Through the batch processing of the large-scale historical production and operation data of the enterprise, the analysis results can be used to formulate the enterprise development strategy, and the real-time requirement of the analysis results is not high.

There are many application scenarios for streaming. For example, when customers browse the web, enterprises can implement real-time product promotion or advertising. When customers use mobile phones to access applications, they can push the latest promotions from nearby businesses to customers according to their location and applications. Social hotspot analysis is also a typical application of streaming processing, which can show social hotspots in real time based on searching big data.

Value creation is the goal of big data's analysis. Data modeling, big data processing, strategy implementation and analysis result display process all play a very important role in reflecting big data's value. In the big data processing stage, the use of batch processing or streaming processing depends on the requirements of the application.

(this article is excerpted from: Li Fudong's "big data Operation-New thinking of Service-oriented Enterprise Architecture", forwarded by the author, the picture is from the network)

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.