I always find this concern amusing. I've always liked the fact that in cool weather, my things get small and pulled up close. The issues I have with most shorts that things do not stay put disappear.
Now, core temp is an issue for this skinny guy. I wear UnderArmour jockey/briefs with the 9" leggings under my shorts below about 60F and add thermal underwear as needed.