Triatheletes use shorts with a thinner pad (there isn't time to change between stages), and I guess you could try them. No matter what, the pad is going to soak up water and be less comfortable than a pair of swim trunks.