I have a hard time with my feet getting cold. I had to stop and use toe warmers. After moving them to the bottom of my foot at the coffee shop, I was toasty warm on the way home.
Here is an idea for winter rides - "coffee shop ride". We go out ride 10-15 miles to a coffee shop. Warm up and then ride 5-10 miles home. This is in 20-30 deg temps. The other approach is to ride some place for lunch - have done both this month. Last year I kayaked at least once a month all year round. This year, I am going to focus on year round biking
I have new REI jacket and wind pants for cycling - what a difference. I use ski gloves and my hands are OK.