I'm the same way. I tend to underdress because of that and even then I'm usually sweating by the 2nd mile. Granted it doesn't get too cold here in San Diego (coldest winter daytime temps are in the upper 50s, early mornings when I ride get as cold as the upper 30s/low 40s), but the ocean breeze makes it feel much colder than it actually is so during the fall/winter/early spring I almost always end up cold and sweaty.

My feet especially feel the cold as I'm the type that has sweaty feet even if I'm sitting around doing nothing. Wool socks have been a godsend for keeping my feet warm and I cut the liner out of some cheap windproof/waterproof gloves and wear the shell over my riding gloves in the early mornings (yes, my hands get cold fast). I used the gloves this past sunday on a 54 degree morning and while my hands were a bit sweaty, they were nice and warm.