I'm actually a big believer in data over anecdotes. My father died of prostate cancer and there is much data behind genetics being the top predictor. My urologist went though other studies that showed I'm not that high risk with other factors, but the genetic factor says err on the cautious side.
My urologist did point me to a 2013 NIH study that did conclude long distance biking causing elevation in PSA when measured 5 minutes after the end of the ride. But by 48 hours, less statistically significant. But he pointed out the same paper showed that the standard recommendation of avoiding sex (or ejaculating, anyway) for 48 hours before the test was a bigger factor. I now avoid both for a few days before the test!