Shulou(Shulou.com)06/03 Report--

I believe that many big data beginners or friends who want to switch to big data development are most concerned about what big data development can do.

What is big data?

The word "big data" has appeared frequently in the media since 2007. Although it has been more than 10 years, people's understanding of it is not uniform, and sometimes there are even misunderstandings about it. For example, many people confuse "big data" with "large-scale data".

If we want to know what big data can do, we must first find out what big data is and what are its characteristics.

The most obvious feature of big data is his large volume, but the data is only large, not big data. For example, the data of a person's complete gene map is between hundreds of GB and 1TB, which is large enough in terms of data. But it doesn't make much statistical sense. Therefore, the large volume is only a feature of big data, not that most of the data can be called big data.

Big data in addition to a large amount of data, some big data experts summarized the characteristics of big data into three V, namely, Vast (large amount of data), Variety (diversity), Velocity (timeliness)

Just a large amount of data does not make any sense, we need to manage the data 'analysis in order to achieve high commercial value.

In what ways can big data be used?

Big data's application is so extensive that it can be said that big data has revolutionized various industries, including logistics, marketing, customer management, medical care, retail, environmental protection, and so on.

In the retail industry, prices can be adjusted timely according to demand and inventory.

The medical industry can analyze the reasons according to the characteristics of many patients. When the order of magnitude is too small, these characteristics are not obvious at all and will not be taken seriously. Only in a large amount of data can we find phenomena that can not be noticed at ordinary times.

In the aspect of public security, the area and probability of crime can be predicted according to the previous crime data.

In terms of entertainment, for example, the production company of House of Cards has created popular TV dramas based on past user habits.

What knowledge do you need to master to learn big data?

Java SE is the so-called Java Foundation, sql (recommended to start with mysql), Linux

two。 Big data offline analysis: such as Hadoop Hive HBase, sqoop, flume, etc.

Big data real-time analysis: Scalc language, Spark, etc.

Big data Machine Learning (extension)

Spark MLlib: machine Learning Library

Pyspark programming: the combination of Python and spark

Recommendation system

Python data analysis

Python machine learning

If you want to know more, you can add wx:fiercelf.

Author: Youxin Kechuang-famous teacher Liu Feng

Source: CSDN

Original: https://blog.csdn.net/weixin_36043432/article/details/91367065

Copyright notice: this article is the original article of the blogger, please attach a link to the blog article to reprint it!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.