Surly Pugsley makes an awesome dirt/gravel road touring machine. It's also a super fun bike to mess about on closer to home. It can be run with the 4" wide tires which are no harder to pedal that a typical 2.1-2.2" MTB knobby. You can also run 29er MTB rims and any touring/MTB tires you feel like.
My buddy and I rode two fully loaded Pugsleys ~450kms on the CDN GDR last year...longest day was ~140kms uphill over a pass.
Don't let the big wheels fool you these bikes can roll fast and give a very cushy ride on rough roads.