Shulou(Shulou.com)06/03 Report--

What is big data?

In the big data era, written by Victor Mayr-Schoenberg and Kenneth Kukeye, big data means that all data are analyzed and processed without shortcuts such as random analysis (sampling survey).

So how much data can be regarded as big data? in fact, there is no clear definition. However, IBM put forward big data's 5V features: Volume (mass), Velocity (high speed), Variety (diversity), Value (low value density), Veracity (authenticity). This is also the characteristic of big data that is generally recognized by everyone at present.

This 5V feature reflects that big data has a large amount of data, fast and diverse, while big data has the characteristics of low value density, while big data may also be mixed with some interference, affecting the authenticity of the data. Therefore, we need some technical means to quickly deal with large amounts of data, and be able to mine valuable information from big data.

Where did big data come from?

Big data of the mobile Internet mainly comes from four aspects:

(1) content data. After the era of Web2.0, everyone has become a media, producing content on the Internet, including text, pictures, videos and so on.

(2) E-commerce data. With the development of e-commerce, online transaction volume has accounted for most of the entire retail transactions. Each transaction contains information about buyers, sellers and the entire value chain behind the goods.

(3) Social data. As mobile social communication has become the most important way of social communication, social communication is not only the role of communication between people, social data includes a variety of important user profile information, such as people's preferences, life trajectory, spending power, value orientation and so on.

(4) data of the Internet of things. Various industries have emerged the needs and solutions of the Internet of things, generating huge amounts of monitoring data all the time.

So so much data, contains a lot of valuable information, this information is not presented in an intuitive form, need to have a way to deal with these data, whether it is computing, storage or communication, have put forward very high requirements, cloud computing technology is the solution to the calculation, storage and communication of huge amounts of data.

What is cloud computing?

Cloud computing is a pay-per-use IT service model, which provides available, convenient, on-demand network access to a pool of configurable computing resources (including networks, servers, storage, applications, services) that can be provided quickly with little management or interaction with service providers.

The required cloud computing resources can be purchased and deployed directly on the management website on the cloud computing service provider.

Then there is one of the most important keywords in the definition of cloud computing: on demand. Cloud computing providers provide computing resources on demand according to the needs of users. in addition, cloud computing architecture has great flexibility and scalability, because all the actual physical resources are virtualized (abstract), configurable and manageable.

Cloud computing technology includes distributed file system, distributed computing, distributed data storage and so on. Based on the cloud computing architecture, we can achieve a high concurrency processing system to deal with massive requests, can also build a cloud storage system to store massive data, and can also build a distributed computing system to mine data.

With regard to the conceptual difference between big data and cloud computing, let's summarize: big data is talking about an application scenario in the context of mobile Internet and Internet of things. Huge amounts of data generated by various applications need to be processed and analyzed to mine valuable information. Cloud computing is a technical solution that can be used to solve the on-demand construction needs of computing, storage, database and other IT infrastructure. The two are not on the same level.

The relationship between big data and Cloud Computing

Well, the above mentioned the difference between big data and cloud computing, and there is a very close relationship between the two. Big data is a very important application scene of cloud computing, and cloud computing provides the best technical solution for big data's processing and data mining.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.