Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

This is a file that contains directions for search spiders. Its content depends on whether the user has allowed search engines to crawl the site.

This is a file that contains directions for search spiders. Its content depends on whether the user has allowed search engines to crawl the site, either through the WP interface or a plugin.

Note that robots.txt does not actively block the site. Search engines keep to its rules out of their own design.

history | excerpt history