Thanks for the responses, guys. For whatever reason, I thought everyone always used two at a time.

I did notice that when I put a ton of weight into the pannier, it did ride weirdly if you stood up to mash. Otherwise, you can't tell on the bike.