You'd have to specify day, month, and year to get today's posts:
$my_query = new WP_Query( array(
'cat'=>1,
'year'=>date('Y'),
'monthnum'=>date('m'),
'day'=date'day'=>date('d'),
'posts_per_page'=>-1 ) );
Leaving day blank just doesn't set that query var, so its not restricting your query at all.