As mentioned above, it may be because of rolling terrain. I have definitely had rides where it was warm climbing but chilly descending. Learned after a few times that it was just easier to unzip the jacket/vest on the climb (aero isn't a big deal then anyway) and zip it back up for the descent.