With the right gear, you'll be fine even below 0 C if not raining/sleeting. Even that's doable but miserable. The key is keeping your core warm, and a head cover is an important part of this. With a warm core, circulation to the feet and hands are enabled. Layers are important for being able to easily shed as the day warms up.

Or head south. I live in North Texas and that's what I do.