I actually have the same problem with my ears being the first thing to feel the effects of the cold. It is now in the upper 40's when I come to work and I am very comfortable with a pair of windbreaker pants, wicking long sleeve shirt and a sweatshirt. However, if I do not cover my ears in the mornings then I get bad earaches for some time after getting to work.