While I do not have a bug, I frequently commute with one pannier. You may notice an extremely small difference in your balance. However, I find it so miniscule that it does not matter. The lovely wind around here does more to affect my balance than one pannier ever will.

I would assume the same would apply to the bug.