I used to not like winter riding because I didn't have the right clothes.
I've recently aqcuired some sport-cycling specific winter clothes and they are warm enough but still allow excess heat and sweat to find their way out.
With "normal" clothes I would always heat up too much and start getting nauseous.