I rode this morning in Chicago, and other than some cold hands and feet, stayed pretty warm. My rear derailleur didn't want to shift at first, though. And it was only -15F in the city.
Last night was worse, heading straight west into the 19mph wind with -6 temps. Sucked the energy right out of me! I had trouble mustering up enough strength to finish the last mile (of 6).