I only ride in shorts. If it's too cold for short it's too cold (IMO) to ride
I wear t-shirts if it's above 60F, between 50-60 a long sleeve t-shirt and below that a jacket (still shorts though)
Fortunately I live in an area that rarely gets below 40F so I rarely miss rides because of temperature