While in theory different length stems would affect handling, in my experience (with 120 to 60mm on different bikes) it's not so noticeable. At least for my conservative and slow riding style...