Lots of weight in a handle bar bag tends to make the steering worse. Plus, more weight can make the bag more prone to bounce up and down (which is kind of annoying).