It's been in the single digits the last few days. 20 or 30 minutes of spinning to and from work and I've been getting along with the same setup as above plus a stocking cap.

My toes and fingers have been a little colder than comfortable, but not terrible.