The 2 bikes I use Most have front racks, 1 has repeated use , fetching Groceries, in All 4 panniers, if needed.

the other one I never got a rear rack for, at all ..

Low riding front loads increase the stability nicely..


if you can fit everything in 4 panniers, nothing on the back rack, top
the bike should handle fine on the road..
its the loose weird stuff on top of the rear rack you would avoid ..