Good for you! You'll be in shape, and there's something about riding in the cold that just makes you feel good (after you get where you're going and warm up).
I use ski gloves, they work well down to the low 20's with high humidity. Anything colder than that here, and I won't need to ride, because everything would be shut down.