Shulou(Shulou.com)06/02 Report--

This article mainly introduces the common reasons for the decline in the index volume of the website, which has a certain reference value, and interested friends can refer to it. I hope you will gain a lot after reading this article.

First, the common reason leading to the decline of Baidu index-the reason of the website.

1. The URL url where the content data is located is not standardized and unified.

[our own site url specification is unified]

Multiple domain names can access web content normally. Multiple url forms under a domain name can access the same content, such as case url, url rule changes, etc.

Solution: select the primary domain name (or primary url), all url under other domain names will be redirected to the primary domain name (or primary url), and the webmaster tool will submit the domain name revision (or directory url revision)

[external platform uses its own station data]

A, market cooperation, site data is called to other platforms; content is actively outsourced, promoters fully forward their own content to high-quality platforms-both of these two reasons may cause search engines to include content from external platforms and reject the content of the original website.

Solution: use the active push function of the webmaster platform link submission tool to submit new links to the site in time and delay the time to call content to other platforms

B, be mirrored, and users can access their own content directly through the domain name or url of other hosts.

Solution: focus on domain name resolution security and server security; bind unique resolvable domain names or links to unique accessible url; pages using absolute addresses

2. The popularity of the site has declined.

[page content related]

A. The quality of the content has declined.

Solution: to improve the quality of content, see Baidu webmaster College for details; put an end to simple copies and do more integrated information.

B, the quantity and frequency of updates are decreasing.

Solution: stable update frequency, according to the development of content, expand the editorial team, produce more new content, so that the site index to avoid decline, continue to increase. (when the number and frequency of updates decrease significantly, then the quota will decrease, first of all, it shows that the crawling frequency decreases, resulting in a decrease in index volume.)

C. Timeliness information disappears.

Solution: most of the timely information will not be retained in the database for a long time, so it is necessary to continuously mine new time information points and integrate the relevant content.

D. Bad information appears in some areas.

Solution: put an end to a large number of foreign chain soft text, bad pop-up ads, illegal sensitive information, content specifically aimed at search engine cheating, etc.

[offense punishment algorithm]

Solution: pay attention to webmaster tool news and Baidu web page search dynamics. Follow the official announcement to correct the site, and give feedback, and then wait for the algorithm to be updated.

[special url is not trusted]

Solution: customize the index query rules for all kinds of url; locate the special url; with declining index volume to check the current, previous day, this week and historical indexes of this kind of url; find out the possible problems of the data that has not been entered into the database; after processing, enhance the data communication between this kind of url and Baidu (through sitemap, batch submission url, data push, etc.).

[the trust of the site is reduced by the search engine]

A, suspected of illegal voting (link factory, etc.)

Solution: cherish the voting rights of their own pages, resolutely do not vote for low-quality web pages, and minimize the export links of the site.

B, theme change (e. G. from education to health care)

Solution: submit the web pages in the old field to Baidu after deadchain processing, block the access to the old url, and then launch the new topic-related content to strengthen the data submission to Baidu.

C, be implicated

There are too many illegal sites under the same ip, and most of the websites run by the owners of the same domain name are punished and in bad condition.

Solution: leave the bad neighbor, get the relevant feedback of the products of the search engine, request the lifting of the ban, and wait for the normal index to be restored.

D, policy reasons

For example, the stability of Hong Kong mainframe and foreign mainframe sites may be poor due to various reasons you know.

Solution: domestic mainframe filing, legally in line with policy management

3. Related to web page template

[restrictions on spiders in the main content area]

Solution: remove the restrictions on logging in and viewing information, so that spiders can easily and freely "collect" data from their stations.

[technology that is not friendly to spiders]

Solution: do not enable spider-unfriendly technology to invoke content that needs to be identified by spiders.

[responsive templates interfere with spiders' recognition of page types (pc, mobile)]

Solution: submit specific url correspondence (parrten level as far as possible); meta mark mobile version of url and devices suitable for browsing; self-adaptation; enhance the differentiation of pc and mobile source tags of different templates to help Baidu identify page types

4. Source code correlation

[serious source code errors, such as coding errors, tag errors, etc.; serious source code changes, spiders "collect" data and re-observe and analyze; changes in TD (web page title, description) under a certain type of url, such as large proportion of changes and large number of pages, the page will resume the process of building the index database after changes, and will disappear online if the page quality does not meet the standard of building the index database]

Solution: verify the source code, the accurate source code is the basis for spider "collection" data analysis; link chain structure, url address form, page theme, page html tags in various areas as far as possible to maintain the situation before the change; gradually, phased replacement of TD (page title, description), combined with the page theme, the actual needs of users to develop a reasonable TD, do not deceive and mislead users.

5. The url that has been stored in the database changes the status of spiders.

[robots declares that spider crawling is prohibited]

Solution: check Baidu webmaster tool robots and crawl.

[the url rule changes and the original url cannot be accessed]

Solution: especially for data migration between linux and win servers, there may be changes in case url support to ensure that all kinds of url rules remain unchanged. When url must be refactored, do a good job of redirecting the old and new url301, and the webmaster tool submits the revision requirements.

[error page]

Solution: due to erroneous deletion, the data can be recovered, and the update changes of url corresponding to web page content can be maintained, and the crawling frequency can be increased. If you are sure to delete, then submit the dead chain, delete the dead chain, and then prohibit it by robots. There is no need to worry about the index drop in this case.

[invaded]

Solution: prevent url from illegally redirecting spiders; prevent web content corresponding to url from making great changes to spiders, especially those that violate the law and discipline

6. DNS, server problem

[DNS problem]

Dns is unstable; dns is not secure

Solution: choose reliable dns services; communication emphasizes the stability of spiders; prevent dns parsing to abnormal ip; to prevent frequent changes in parsed website ip. Prevent dns management loopholes, resulting in malicious parsing; prevent dns parsing from being attached to platforms that lack technical capabilities, management norms, moral and legal constraints, such as small agents.

[server problem]

A, poor accessibility

Solution: try to enable users from all operators in the target area to open the website within 3 seconds, preferably within 1 second; monitor the running status of the website, reasonably set all operators' monitoring nodes, monitoring projects and monitoring frequency in the target area

B. Block Baidu ua or ip

Solution: use more Baidu webmaster tools to view the situation of Baidu crawling web pages, you can see

C, setting of anti-brushing pressure

Solution: parse the spider to the dedicated space; if there is a sharp increase in access to the ip, check to see if it is a spider and then determine whether access is prohibited.

Second, the common reasons leading to the decline of Baidu index-Baidu reasons

1. Quota reallocation

The amount of the same kind of data is close to the total amount of index allocation, and if the quota is redistributed, if it goes up, it will fall.

Solution: surpass the competitive products and strive for high distribution.

2. Data exception error

A. Punishment for errors

In response to a certain kind of evil behavior, the new algorithm is online, but due to the butterfly effect, some sites are wrongly punished and a large number of indexes are cleared.

Solution: feedback Baidu side, request to lift the punishment.

B. Regional data anomalies

Abnormal data crawling or query in some areas, resulting in misjudgment of the site situation and removal of the corresponding index data or output error index, such as Baidu dns system upgrade event.

Solution: feedback Baidu side, Baidu check the implementation of spiders around.

C, interface call data error, data loss, data backup derivative exception

Solution: feedback Baidu side, Baidu check the relevant data.

Thank you for reading this article carefully. I hope the article "what are the common reasons for the decline in website index volume" shared by the editor will be helpful to everyone? at the same time, I also hope that you will support and pay attention to the industry information channel. more related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.