Check the Winter forum for some opinions that'll blow your mind!

I've worked my way down to below 10F. With no wind, it's almost pleasant, although you have to balance "ride fast to generate body heat" with "ride slow so the wind doesn't freeze you."