Gore size chart is accurate. In my experience there is enough elasticity (Ozons, Xenon Sonics) to go up a size, but you should definitely get a size smaller than Italian brands or Assos.
BTW, have you tried bibshorts? Assuming you don't have to take #2 dumps during your rides, bibs are really nice.