I love around 65 or 70, sunny as I can get, at least here in Boston. I might feel different if I was just north of Baja. That's cool enough that I can freak out like nobody's business and only get the "ordinary" amount of sweat (I also sweat like nobody's business) but if I want to stop for a bit, I can sit down and be warmed by the sun.
So I guess my answer is no. Unless I'm riding in the snow. Then of course it's got to be nice and cold. Anything above 20 degrees ruins the snow, so keep the thermostat down low, ok?