I concur. Doesn't matter.
Now, here's a situation where I have noticed impaired handling - large, heavy bag on top of my rack. It was OK until I tried to do some out-of the saddle acceleration, when the high load really affected my ability to rock the bike back and forth.
But even that wasn't a big deal outside of sprinting.