I use a thin skull cap specifically made for winter; sometime I use two when it's down in the lower twenties. Then I use the face mask. The helmet will only need to be readjusted come spring. Winter can be tough and cold, but worth the trouble: it's the best time for riding.

Cheers,