Agree with the OP. Hate the cold (why I moved from NY to GA) but find that I can ride really well from 48 -80 degrees. Essentially I get in really good shape until mid May at which time the temps and the HUMIDITY in Georgia get into the 90s and I essentially stop riding. I don't want to stop riding but I'm not a morning guy and by the time I get out...it's just too darn hot.
And now that summers in the south seem to be getting hotter earlier, it's even worse. I hate losing all my conditioning every summer, but the humidity down here is just killer.