Save the old worn out ones for that.

Also so called Tri-shorts usually don't have pad, just a thin 'chamois' They also usually have a shorter inseam so they won't poke out from under your over shorts.