if dressed properly the cold is manageable you will always hate the first mile or so until you have warmed up after that it is just a matter of staying warm, with the right clothe a breathable windproof jacket and wool, you can do quite well, the problem is if you get too warm and start to sweat then you start to freeze again, wool keeps you warm even when wet and is a good natural fibre for underlayers. a trick for keeping your face warm is 60+ SPF sunblock it can keep you face warmer and cut the wind chill on your face though it is still best to have a gaiter over your face as well. a heavy toque is advisable a lot of heat is lost through your head.
Snow and ice are a different story, as a former driver examiner I have seen first hand how bad some drivers are out there and I may trust my riding abilities but I don't trust the other guys so I put my bike away at that point.