This happens to me as well at about 50F or lower. Very painful earaches that turn into headaches.
I am bald and at that temp I also wear a skullcap so the whole issue is negated (generally). Occasionally I screw up and my iPod ear buds help me out.