If your core is warm the rest of you should stay warm, even if your head is uncovered.

Interesting factoid is that if the rest of you is warmed up and your head is the only thing exposed to cold, you don't shiver.

Wind chill is an entirely different thing, your ears and nose have poorer circulation and should be covered as these are the first things to freeze and fall off.