the worst thing is the initial 5-10 minutes on the bike. it feels soooo cold sometimes (especially if you have to go downhill). if you can survive that, then you'll quickly warm up and be comfortable.

i often start off feeling like i'm underdressed and then end up feeling overdressed by the end. my feet are the hardest for me to keep warm.