Pannier weight (distributed low and evenly) tends to have a stabilizing effect on most bikes. It's also just what you are used to - I ride a small-wheeled folder that makes my gravel bike feel like a truck... no problem doing long days on either.