I'd suggest you leave the extra two pounds of rear rack on each bike for the first trip. Part of the way through, try moving those panniers to the rear. I've found loading front panniers really damps down front steering with "normal" bikes (not the low-trail variety that gets a lot of press from Heine et al). Try both and see how you like it.