I also rode most of last winter. As long as the roads are rideable. Once the snows come, we lose a few feet of width and it makes it too dangerous.
There were times it was very cold at the start of the commute, but I had so many layers, I was soaked from perspiration by the time I got to the office.
It only takes getting started sometimes. Try cutting the commute in half by driving the first part. 20 miles seems like a lot in Calgary. Ok in Raleigh.