One bit that is often missed - delete readme.html
in WordPress root. It not only identifies installation as WP but also has precise version. And don't forget to repeat on updates.
Related Question: Prevent access or auto-delete readme.html, license.txt, wp-config-sample.phpPrevent access or auto-delete readme.html, license.txt, wp-config-sample.php