Shulou(Shulou.com)06/03 Report--

Now, due to the popularity of artificial intelligence, the talent in this area is scarce, needless to say, the NO.1 in the industry, so all kinds of people have gathered in the Internet industry, some change careers, some change jobs. There must be a lot of questions for beginners in learning. What questions are they? I'm here to answer them for you. Before sharing, I still want to recommend big data Learning Exchange Qun: 710219868 to enter the Qun chat invitation code and fill in Nanfeng (required) and I will know it is you.

First, we must first clarify a concept, what is big data.

Big data, also known as a huge amount of data, is a large amount of data, a wide range of sources, a wide variety (log, video, audio), large to the PB level, the current framework is to solve the PB level data.

Professionally speaking: big data (big data,mega data), or huge amount of data, refers to the massive, high growth rate and diversified information assets that need a new processing model to have stronger decision-making power, insight and process optimization ability. In the big data era, written by Victor Mayr-Schoenberg and Kenneth Cukeye, big data refers to using all data for analysis and processing instead of shortcuts such as random analysis (sampling). Big data's 5V features: Volume (mass), Velocity (high speed), Variety (diversity), Value (value density), Veracity (authenticity).

Second, what language foundation do you need to learn big data?

First of all, learning big data needs to have the foundation of java,python and R language.

1) at what level can Java learn from big data? Java needs to learn javaSE. Javaweb,javaee is not needed for big data. Once you learn javase, you can understand the hadoop framework.

2) python is the easiest to learn, and the degree of difficulty: python < java < Scala. Python is more intuitive and easier to understand than java, because if you know Python, you still have to learn java. You have learned java, and then it will be very easy to learn python. You can learn python in a week.

3) R language can also be learned, but it is not recommended, because java uses the most people (http://www.199it.com/archives/721259.html), big data's first framework Hadoop, the bottom is all written by Java. Even if I learned R, I still can't understand handoop.

The role of java in big data is to constitute big data's language, big data's first framework Hadoop, the bottom is all written by Java, so it is recommended to choose to learn java. Let me give you an example to illustrate their division of labor and role. Java pays attention to business, big data pays attention to data, the front end is the face (page display), java is the arm (business), big data is the straight male brain, artificial intelligence, deep learning is the brain with EQ.

Example:

You: I'm thirsty

Straight brain: ha ha, drink plenty of water!

EQ brain: I have orange juice, mineral water and green tea. Which one do you like? But let's see if you like to drink. Would you like a glass of orange juice?

III. The direction of career development

Learned big data, do not need to start from java, you can directly do big data development engineer and other accumulated several years of experience, you can do algorithm engineer. Take a look at what positions big data can take:

Big data Development engineer

Data analyst

Hadoop Development engineer

Spark Development engineer

Data Warehouse Development engineer

Data cleaning engineer (ETL)

Big data architect

Algorithm engineering

IV. Advantages

Big data is strongly supported by the state and a lot of resources are invested in this area. Big data Center sits in Guizhou. Artificial intelligence and cloud computing are based on big data, which requires a large number of big data talents.

Big data's salary and treatment for talents

In general, the average monthly salary of big data-related jobs in first-tier cities is 12-15K in Beijing, the average monthly salary is 17K, and the annual salary of big data algorithm engineer is about 300000-500000.

Do you have any education / major requirements to study big data

I also found a job in high school, but college degree or above is better. Although I have a bachelor's degree, I have not learned practical operational skills in four years of college. What I have learned is not needed at work, but it is easier to understand some things.

7. What are the means for big data to grab data?

Crawlers, Flume

Do you learn from big data to use those frameworks of java?

SSHSSMSpringBootSpringCloud these frameworks will not be used in big data, for those who learn the technology, of course, it will be better to understand these technologies.

IX. Learning route

JavaSE + linux + Hadoop biosphere + Strom + Spark + algorithm

Normally, you have to do the following before learning big data:

1. Learn the basic programming language (java,python)

two。 Master the basics of entry programming (linux operation, database operation, git operation)

3. Learn the various frameworks in big data (hadoop, hive, hbase, spark)

These are the three steps that must be done to learn big data normally. If you have the foundation of java and then you have basically achieved half the success, at least you don't have to be annoyed for the learning of the basic language. The real learning of big data can not only stay at the theoretical level, for example, the frequently used spark framework currently supports the development of java or Scala in both languages, and now the Python language can also support it. Big data's direction of cutting is omni-directional, the basic language learning is only a very small aspect, programming to the final implementation of the programming idea, with the guiding ideology to learn can be a lot more convenient.

The above is a summary of some of the problems encountered by students who want to develop their study towards big data. If you find it useful, you can pay more attention to it. Of course, you will encounter more problems in the process of learning. Welcome to communicate with me. Here I still recommend the exchange of Qun: 710219868 into the Qun chat invitation code to fill in Nanfeng (required). The group is all developed by big data, if you are learning big data. The editor welcomes you to join us. Everyone is a software development party, sharing practical information from time to time (only related to big data development), including my own 2018 latest big data advanced materials and advanced development tutorials. Welcome to advance and want to go deep into big data's buddies.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.