I use a 30Seven baselayer when it's cold.
http://www.30seven.eu/en/category_30.aspx
You can adjust the heat-level, so if you it's warm enough you can turn it off... It's also very breathable so my body temperature is not too high, I think
They also have thos heated gloves and insoles but I haven't tried them