Go with panniers, a fully load & heavy backpack will raise your center of balance. If your bike can take them, load panniers on the front. More times than not, the bike will handle better.