That's pretty much what I would choose for a long ride on rough pavement and gravel. I just got my first rigid fork road bike in 30 years, which is great for good pavement. But I'd still prefer my hybrid with suspension fork for rougher terrain. Easier on my aching back and neck. I'd just ride slower and get there comfortably.
There's a German gal who's touring the world on a Surly Troll, riding mostly off road. Only change I'd make is a suspension fork instead of rigid for that type of thing.