Originally Posted by
ptempel
You must look like the Michelin man when its below freezing.

Maybe try thermal bib (or pants) and jacket?
OP is asking about upper body. My system work for me, given the wide temperature range of my area between morning and evening and an hour long commute that sometimes varies 10 degrees from start to finish. Mainly keeps me from dressing too warmly.