Pick up a scarf at a thrift store and look for sales on balaclavas.

I've probably ridden without anything on my face down into the teens but I doubt I was very comfortable.