I went back to my Garmin Connect page. The difference in elevation gain between Saturday's ride is a lot more than I had originally thought. For Saturday (Santa Ana event) the elevation gain was 3,100 feet. For Sunday's ride (same route no Santa Ana winds) the elevation gain was only 1,150 feet.

Big difference!