Those chilly humid early AM rides can be pretty chilly when doing a descent. You're lucky you don't need a full winter jacket in our mild climate.. I'd at least spring for a good base layer, arm warmers, knee warmers and maybe a wind proof shell jacket. When it's in the low 40's this is hardly overdressed.