Shulou(Shulou.com)06/03 Report--

0. Preface

Many people report that they are at a loss as to what to do after learning the basics of Python and do not know where to go next. As an early crossover (civil dog), I have a lot of experience. This article will be combined with the above picture to point out the direction for the newcomers, which can be used as a reference.

Emphasize here: if you plan to rely on Python to escape your existing job (such as civil construction), think carefully about what kind of work you plan to do, Internet marketing, front-end, operation and maintenance, crawler, data analysis, data mining, Web development? Strong recommendation: directly on the retractor or Boss direct employment, targeted learning is more secure. If you want to play amateur, then join us for amateur, ho ho ~

. In the process of getting started learning big data, I have encountered learning, industry, lack of systematic learning route, systematic learning planning, welcome you to join my big data learning communication skirt: 529867072, skirt files have my big data learning manual, development tools, PDF documents and books, you can download them by yourself.

1. Goal determination

Everything in advance is established, and if not, it is wasted. Make it clear that you want to deal with things in advance, and there is generally a direction. For example, you are going to analyze local house prices, or some kind of data from e-commerce, or data from a certain vertical area, etc.

two。 Data acquisition

Crawler is the only way for beginners of Python. Through crawler, you can not only get data, but also understand how Web works. The former can be used as the raw material of data analysis, and the latter can be used as the basis of data Web visualization. As for your use of Request, Scrapy, or Selenium, you can feel free. This is not the focus of the official account. There are many examples of Duniang or GitHub for your reference.

3. Data analysis

The book "data Analysis with Python" describes in detail the use of Pandas, which can be used to achieve the underlying process (data collation, description analysis, insight conclusions, report writing) after the above process, which can be called "data analysis".

4. data mining

The upper path (modeling analysis, model testing, iterative optimization, model loading, report writing) after data collation in the above figure can be called "data mining". Libraries or tools such as Sklearn, XGboost, Pytorch, TensorFlow, Spark, Hadoop, etc. will be used.

5. Report writing

Whether it is data analysis or data mining, it is ultimately reflected in the report, which can dynamically display the data online, or it can be offline static report, or insert PPT. Matplotlib is the foundation at this stage, and you can feel free to use other visualization libraries or non-Python tools. The key point is whether the conclusions of your analysis can be confirmed by the readers.

6. Demand feedback

From report writing to goal determination, this is a closed loop of product iteration. Similar to the PDCA of civil construction organization and management.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.