I have recently moved server and upgraded my wordpress install to the latest version.
Now if I try to access /feed, I get a 404. It used to work. /?feed=atom works correctly.
UPDATE: I fixed it. Virtual host definition had AllowOverrides turned off, so .htaccess was not being picked up. Thanks all for the comments.