Is it really enjoyable to ride your bike at these extreme cold temperatures? That would definitely take all of the fun out of it for me.
Do you enjoy all the effort it takes? Is a bike your only transportation option on such cold days?
If it were as cold as some of you are describing - below freezing, even below 0! - I'd definitely take the bus/train, but then I suppose not everyone has access to those options.