The effect of ambient temperature on gross-efficiency in cycling
Raise the temperature from 60ºF to 96ºF, and power drops by around 20%. I would say 55-60ºF is perfect. At that temperature there's no need for layers, and humidity doesn't much matter.
I don't think it's coincidental that the bulk of my PRs come in the SoCal winters, from November through March.