Shulou(Shulou.com)06/03 Report--

This article will explain in detail why the agent ip is not easy to use. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article.

1. The surrogate ip scanned is temporary.

two。 The traffic is so heavy that the server is down.

3. Not an agent, ip4. It's validated.

A proxy for 5.http, which is used to access https.

6. Proxy exception, connection interrupted, bandwidth full, error returned.

If you don't want to spend money, you can only find a stable agent ip, and then use it. And the general agent pool, are to take Baidu, Zhihu, Douban Ash web site to visit, has become an explanation can be used, no achievement is failure.

The most extra points or something. I have seen the haipproxy code before, and I have to write my own verification if the success rate is high. To put it bluntly, before using the crawler, I think it is meaningless to try to visit it to improve the success rate. All this is nonsense. Here are the main points.

In fact, a small number of free proxy ip are very stable proxy servers, so these servers can be used for a long time. The free proxy ip I crawled, in which the access success rate of the filtered remaining ip is basically more than 90%.

First of all, in fact, the easiest way is to judge by the open port of the server. If the server has open ports 80, 3389, 3306, 22, etc., then the server has other services running, and the probability of hanging up is very small. If it is the government and school servers, it will be more stable. Of course, it is possible to open other ports.

Second, to judge the access speed of the server, you need to visit a number of different websites to get the average, so that the access speed is more stable.

The longer the survival time of the proxy ip is, the more stable it is. Of course, this can only be calculated after you build the crawl.

This is the end of the article on "what is the reason why proxy ip is not easy to use". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.