Great setup! I did something similar last summer; I had a 22lb bike with a 42lb weigh-in with 2 days of food and water. It was fun having such great handling and responsiveness from my rig while my buddies were dealing with squirrely handlebars and heavy tail ends thanks to panniers.

Biggest reason I ended up going back to 2 Ortlieb back-rollers instead of dry bags and frame bags was how long it took to break camp in the morning. Lots of little bags to get filled just right. Any issue with that?

Now my camp-to-ride time is less than 10 minutes.