Ive only started this, but tried front, back, handle barbags, all seperately, and noticed what causes what movements. I dont know about moving the panniers back or forward, ill leave that to the pros, but handlebar wobble came from heavy handle bar bags for me... And hand position also affects this somewhat.

I decided just to turn with it, and it tends to go back and forth with no real bad effect.s...