As the temps drop, keep layering up. In SoCal, anything in the 40s is arctic, dead of winter cold. I have ridden in the 20s and could go lower with goggles, warm gloves, and overboots.