Yes, that is the limiting factor (without going to some geeky overly extended stem).
I've kept the extended stems to a minimum, the Nitto Technomic DeLuxe or the similar SR - the Technomic is way too tall for any reasonable aesthetics especially with small 51 cm frames. The exposed section of the stem ends up being longer than the head tube!