When I first started riding I had issues. I didn't have bike shorts then but wore compression shorts. Getting bike shorts mights have helped, but I notice now when I ride without bike shorts I don't have the same issues. I think one or both of the following may have helped, one is I lost weight and don't have the gut folding in on me when bent over and the other is a better bike fit.
That said I got a new pair of bib shorts that seemed to have more padding upfront then what I was use to, it took some getting use to.