I read somewhere that with a more up right position it is better to have the weight higher on your back, and vice versa with a more aero position. When I'm on my bike, it's more comfortable to have it sit lower on my back (like a messenger bag). Sometimes when I get on foot I tighten the straps a bit.
Though to be honest, it usually doesn't bother me enough to fuss with it.