I carry a guitar on the rear as well. No problems handling. For cold weather tours I have two front rollers for the extra volume.
Biggest hassle with four panniers is carrying them onto trains.