Take the 2-minute tour ×
WordPress Development Stack Exchange is a question and answer site for WordPress developers and administrators. It's 100% free, no registration required.

http://chineselearnonline.com/

User-agent: *

Disallow: /feed/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /xmlrpc.php
Disallow: /wp-

Sitemap: http://chineselearnonline.com/sitemap.xml

I just changed to a new server. And my site started to not to appear in the top search results s before. I was wondering if the robots.txt above is blocking some of my WordPress content?

EDIT:

I changed the path from http://chineselearnonline.com/v4 to http://chineselearnonline.com/ also, not sure if this is the real problem and no robots.txt

share|improve this question
    
This is not a WordPress question. –  chrisguitarguy Nov 1 '12 at 4:02
    

2 Answers 2

You will need redirects, as is pointed out, but as for robots.txt, you're missing the allow line in robots.txt:

User-agent: *
Allow: /

Disallow: /feed/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /xmlrpc.php

And this line makes no sense Disallow: /wp- , so delete it.

share|improve this answer
    
There's no harm in adding Allow: /, but this statement is implied (everything is allowed by default except what is specifically excluded). –  k3davis Nov 1 '12 at 11:54

If you changed your site path, the urls previously indexed by search engines are no longer valid.

Google Webmaster Tools has a change of address tool: http://support.google.com/webmasters/bin/answer.py?hl=en&answer=83106

In general, you need to :

  1. setup 301 redirects for your old urls

  2. create a new sitemap

  3. be patient
share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.