Is there a seam in the shorts that's chaffing?

Smaller shorts may work.

This should not happen after 20 miles.

Vaseline or chamois cream on the tip helps. Diving friends have had similar problems when we "technical" scuba dive and sometimes spend as much as 3-4 hours under water in a dry suit.