Get a cycling jacket that folds up and you can put in a jersey pocket when it’s hotter

if it’s too cold and you can’t. Then figure it out. I have a PI softshell jacket that is great in cold weather. Yet I only use it in cold weather. If the weather is changing during your ride then layer and remove as needed.