For marginal differences, I'd say it doesn't matter. Then again, I've never encountered a frame that was too large for me.

A frame too large will tend to put the bars further out in front of you, but a frame too small will put the bars lower. Both could be "fixed" with a stem change.