When I was in college and didn't have a car, I'd bike in just about any weather to get to class or work, including below zero. But I don't recommend it.
I'm persuaded by the argument made earlier that you might be OK until you flat, and then if your hands don't work, you're kinda screwed. It's a little different with skis.