I am a native Mainer. I can deal with the cooler temps easier than I can the heat and humidity.
I think that it is a case of it being a matter of what you are used to. I remember when I was in Texas one year for Christmas, I was running around in shorts and a t-shirt in mid to high thirties temperatures, while the folks that lived there thought it was cold. It was the first time in my life that I have worn shorts on Christmas day.