We have a site on wpegnine that gets about 20k visits a day and heavily depends on ajax for our inbound marketing strategy (lead/visitor processing).
These ajax calls are killing our server performance.
I believe that a good way to alleviate our problem is to disable all AJAX calls to wp-admin for spiders.
They don't need to see our dynamic calls to action and we don't need any visitor tracking on these spiders.
How do we setup our robots.txt, or even better, code in a solution that will keep spiders from using these resources?