for TT bikes, you go one size smaller.
what's really important is the top tube length which is determined by torso + arm length.
For people with unusally long or short legs, that is not true. A long-legged rider will have too much saddle to bar drop (with an increased effective reach) and a short legged rider may not be able to stand over the top tube.