I usually go smaller. My ideal TT is 55cm but most manufacturers will offer a 54 and a 56. I'd much rather use a 110 or 120mm stem on a 54 than a 90mm on a 56.

Another consideration is headtube height. The bigger frame will likely have a taller headtube and it may be difficult to get the stem low enough if you prefer a more agressive position.