It depends....like saddles are so very personal, so are chamois.
I know women who ride long distances who won't wear a short with chamois. A couple of thoughts.
Try a short with a thinner chamois. Lately the chamois in some shorts is getting way too thick. This can be an irritant. Places like Boure still make shorts with minimal chamois.
In general, the chamois may not be right for you...it should be wicking moisture and providing a seam-free sitting area (to prevent abrasions). If it isn't and after 50 miles you find chamois-free doesn't work, try a different chamois. Like saddles, what works for one may not work for others.