Sorry bud, but you said it changes the handling characteristics. I ride your example "twitchy road bike" with a messenger bag with no differences. It goes nowhere and the bike handles the same Proof your blanket statement is dead wrong.

Maybe the 50 miles a day that I do it each and every day isn't enough of a test?