Shulou(Shulou.com)06/02 Report--

What is the correct way to write the php version of zblog robots.txt? I believe many inexperienced people don't know what to do about it. Therefore, this paper summarizes the causes and solutions of the problem. Through this article, I hope you can solve this problem.

The correct writing of zblog robots.txt, php version, robots.txt as the spider crawl of the site to follow the rules, which can be customized to prohibit the directory, as well as sitemap links can be added

Effect:

User-agent: *

Disallow: / zb_users/

Disallow: / zb_system/

Disallow: / MemberCenter

Sitemap:meishi/sitemap_index.xml

Sitemap:xx/sitemap.xml

Code:

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.