I agree that 0 C (32 F) is not very cold. As long as you're dry and active, you should need minimal coverage at that temp. I will wear a light headband, and take that off if I'm climbing a hill. I think all the stuff you're wearing is cutting off the blood supply to your scalp.

Does it feel like "brain freeze" from eating ice cream too fast? Maybe it's related to that.