base layer, base layers, more base layers.
Stop the wind. No matter how clumsy, wear a glove that keeps you warm - ski gloves that let you actuate a brake if need be.
Use a protec helmet that you can slip a merino or poly beanie under. Try and keep the face/neck/earstoes warm. Cold legs can be adjusted to. Extremities can not.
I used to ride my motorbike in 32f to 40f at 100+. It's all about layer, layer, layer and keep the wind out.