I have happily ridden in the upper 20's with no face covering. I do have a cap under the helmet, and ear warmers.

I have never pondered facial frostbite on a bike, but I have nipped a piece of cheek once skiing. It was in the single digits F, maybe in the teens.