The robots tag has no wiki summary.
0
votes
1answer
42 views
wp_redirect and search engine bots
I have some pages and categories you have to be looged in to have access to. I am using wp_redirect to send anyone who is not logged in to the front page if they try to open those pages. Is it enough ...
-2
votes
1answer
90 views
WP in Subdirectory — Multiple robots.txt and .htaccess files?
Assume you have a static HTML site with its own robots.txt and sitemap.xml at www.mysite.com.
Now you add WordPress blog as an adjunct to the site at: www.mysite.com/blog
Do you need to have a ...
0
votes
0answers
15 views
Visitors occasionally see robots.txt instead of content
I'm running into a strange issue that I've never seen before: visitors to a Wordpress-powered website occasionally see the contents of Wordpress's automatically-generated robots.txt instead of the ...