Or get a compression base layer and wear it under your bibs.

Is it with the same set of bibs each time or do you have this issue with all bibs?