I am using the default rss feed widget but want to style it. My question is -where to add my piece of code to style the default wordpress rss widget?
You will need to add XSLT sheet to the RSS declaration. It will automatically beautify the RSS XML.
You have a tutorial here
Otherwise, just use "Advanced RSS" plugin, that allows you to configure the graphics with it ( via XSLT ). Plugin page here