The issues are about where the steering axis sits wrt to your weight. If you go too long you'll feel like you're operating the tiller on a boat.

By changing the stem you just move your hand position relative to the steerer, with the top tube size you move your hand position and steering axis together. Too much or too little stem can make for a quirky ride the designer didn't intend.