It sounds like overall you're warm enough - otherwise your extremities would be very cold. You probably sweat most in the area of your chest and belly and your base and mid layers are not adequate at wicking and managing the moisture.

I'd probably start with a polypropylene base layer to replace your thermals (cotton? polyester?)