Shulou(Shulou.com)06/03 Report--

Now speaking of big data, that is a very popular "buzzword". Everyone is speculating on the concept. Big data is not difficult. How to use big data is still very rare. In my opinion, at present, many people are bragging about big data. But very few people really understand big data. Let's talk about the concept of big data:

Big data (big data), to put it simply, is a huge data collection (IT industry terminology). The Baidu encyclopedia entry is interpreted as this: it refers to the data set that cannot be captured, managed and processed with conventional software tools within a bearable time range. It requires a new processing model to have stronger decision-making power, insight and process optimization ability to adapt to massive, high growth rate and diversified information assets.

In the big data era, written by Viktor Mayr-Schoenberg and Kenneth Kukeye, big data is defined as using all data for analysis and processing instead of shortcuts such as random analysis (sampling). Big data's 5V features (proposed by IBM): Volume (mass), Velocity (high speed), Variety (diversity), Value (value) Veracity (authenticity).

Big data needs to update the model to have stronger decision-making power, insight and process optimization ability to adapt to massive, high-growth and diversified information assets. Big data has the following connotations:

1. A large amount of data, TB,PB, and even EB and other data need to be analyzed and processed.

two。 It requires rapid response, rapid market changes, timely and rapid response to changes, fast analysis of data, and higher performance requirements, so the amount of data appears to be somewhat "large" for speed.

3. Data diversity: different data sources, more and more unstructured data, need to be cleaned, sorted, filtered and other operations, into structured data.

4. The value density is low, because the data is not collected in time, the data samples are not comprehensive, the data may be discontinuous, and so on, the data may be distorted, but when the amount of data reaches a certain scale, more real and comprehensive feedback can be achieved through more data.

Today's society is an era of rapid development. With the development of science and technology, the flow of information, the communication between people's homes is getting closer and closer, and life is becoming more and more convenient. Big data is the product of this high-tech era. Many industries will have big data demand, such as telecommunications industry, Internet industry and other industries that are easy to generate a large amount of data, and many traditional industries, such as medicine, education, mining, power, and so on, will have big data demand. Big data's deep integration with various industries will produce unprecedented social and commercial values.

Jack Ma once said that the future era will not be the IT era, but the DT (Data Technology data technology) era, showing that big data plays an important role for Alibaba enterprises.

This is the concept of big data that I understand. If there is something wrong, I hope to understand and add to it. Let us feel and look forward to the future development of big data.

This article is from lemon pie (12 tips for http://www.lemonpai.com/1419.html 's easy survival in Apache Hive). Please be sure to keep this source, or you will be held legally responsible!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.