I always wear a base layer. +1 what UMD said. I wear Patagonia . Patagonia make them in various thicknesses, sleeveless, short sleeve, longsleeve with 3/4 zippers.

I've learned time and time again raised in AL, lived in CO and TX, deployed to Iraq; bases layer keeps you cooler.