Your head is a fairly effective radiator but it's relatively small surface means it does not contribute to as much heat loss as many think... even in our colder climate a lightweight toque is more than adequate.

Covering my face and ears is much more important.