The tag has no wiki summary.

learn more… | top users | synonyms (1)

0
votes
1answer
30 views

Disable Ajax for Spiders

We have a site on wpegnine that gets about 20k visits a day and heavily depends on ajax for our inbound marketing strategy (lead/visitor processing). These ajax calls are killing our server ...
0
votes
1answer
34 views

I'm using All in One SEO Pack plugin and can't find robots.txt in my root directory.

I found the problem that Google crawler can't crawl my WordPress site contents. To fix it, I tried to follow Google's instruction which add 2 lines in robots.txt file. But i can't find the file. I'm ...
0
votes
1answer
57 views

Hide pages from google and visitors

I have wordpress site where i have few custom type pages. I load the content of those pages with jquery load. But I dont want that those pages are directly visible. So if user goes to ...
0
votes
1answer
158 views

How to solve Robots.txt problem with WordPress fresh install?

I installed a fresh copy of WordPress few weeks ago and I have been having some strange problems. 1- I get this message : "Comments for Yad Faeq yadfaeq.com/‎ A description for this result is not ...
0
votes
1answer
60 views

wp_redirect and search engine bots

I have some pages and categories you have to be looged in to have access to. I am using wp_redirect to send anyone who is not logged in to the front page if they try to open those pages. Is it enough ...
-2
votes
1answer
233 views

WP in Subdirectory — Multiple robots.txt and .htaccess files?

Assume you have a static HTML site with its own robots.txt and sitemap.xml at www.mysite.com. Now you add WordPress blog as an adjunct to the site at: www.mysite.com/blog Do you need to have a ...
0
votes
0answers
24 views

Visitors occasionally see robots.txt instead of content

I'm running into a strange issue that I've never seen before: visitors to a Wordpress-powered website occasionally see the contents of Wordpress's automatically-generated robots.txt instead of the ...