go to a shop that sells them, try them on.

that is really the only way to be sure because those charts do not take in to consideration your body fat percentage.
one of my friends was sized as a womens extra large, even though she was medium, she had been an athlete all her life, and had a great deal of muscle.