Try adjustments on the saddle. I think maybe move the saddle back a bit since you find comfort in riding in the narrow section. Also I had a similar issue with my testicles, I swapped out my saddle with a toupe because I wanted to try a saddle with a cutout and it has helped a lot.