Because of the fact that the rules of Google concerning the SEO recently changed, I would like to know if it still advised to disallow /cgi-bin or not ?

Thank you in advance,


closed as off-topic by Jacob Peattie, fuxia Sep 14 '18 at 9:17

This question appears to be off-topic. The users who voted to close gave this specific reason:

If this question can be reworded to fit the rules in the help center, please edit the question.


It can't hurt (except your robots.txt is publicly accessible, anyone can see your directory), but bots who honor the robots.txt file, will skip that directory anyway. If you don't use any CGI scripts, I would simply block it in .htaccess.

Not the answer you're looking for? Browse other questions tagged or ask your own question.