I'm going to ride if temperature is the only issue.
I'm with the previous posters who are worried about icy rutted craters, though. My city has not been doing so well with snow removal so far this winter, and when snow gets packed down by cars, frozen solid, and then polished to a shine, it's like riding on a six-mile long series of slippery potholes. Which can throw you a couple of feet in either direction, traffic notwithstanding.
So I might cancel for bad road conditions or high winds, but I'm in if it's just the bitter cold.