I find that a single pannier with a light commuting load has no discernable effect on bike handling, even for tracks and trails. With heavily loaded (20lbs+)single pannier, it does become noticable but still not problematic and much easier than 20lbs on your back.