I love riding in the winter! It's almost never
too cold for me, but a whole heap of snow or ice will make it nearly impossible to get anywhere unless you have studded tires.
Once you start riding you'll realize what clothes work for you at different temperatures, but as a general rule, it will be harder to keep your hands and toes warm when it gets really cold. So, prepare for that. Also, a balaclava (or facemask thingy of some sort) with breathing holes for the mouth will be essential.
I mostly ride streets where ice can be avoided, so if you're riding trails beware of the eternal ice in the shade. Otherwise, just use common sense and stay warm!