Looking imbalanced [real word] is a problem of aesthetics.
Not a problem for the cyclist but could be a problem for someone looking at the bike and thinking "hmmmm, that looks funny with only one pannier"
__________________
Bacchetta Giro A20, RANS V-Rex, RANS Screamer