at 50F this morning it was unpadded bike shorts under stretch golf shorts and a sleeveless wicking athletic shirt.
mid-to-low-40's i add -wool- arm/knee warmers, or a wool base layer under a shortsleeve jersey if it's going to be cold and windy.
not a tough guy, but my tolerance is way way up from when i started bike commuting two years ago. i quickly realized that sweat was the enemy and that after 5-10min i'd be much warmer than i thought.....