It is possible that you are getting soggy and cold because you have too many layers. Have you tried cycling without a baselayer? In cool springtime temps, I will often use the jersey as a baselayer and put on a light breathable jacket or vest that I can unzip if I start getting wet from sweat. Sweat needs airflow to evaporate. I'll also second the wool suggestion. Layering wool is absolutely the best option I know of, but good wool is not often cheap.