For that type of riding I'd use my 29er hardtail with rigid fork and disk brakes. I use a Nashbar steel moustache bar with bar end shifters. The tires are 700x47 Michelin City. I've spent lots of time on the dirt on this bike with these tires and it works well.
I use a Axiom rack, skewer mount, but I have used an Axiom seat post rack which has the advantage of moving the panniers higher giving more ground clearance. I believe the seatpost rack would survive a crash better.
I use clip-on panniers but I'm thinking of getting some canvas saddlebags. They would be much tougher.
I wear a daypack and do not use front panniers.
My preferred shelter is a tarp pitched as an a-frame with hiking poles.
I don't have one, yet, but I saw a backpacking stove that burns twigs. It has a battery operated electric fan that makes it burn really hot.
I also saw a video of twig burning titanium stove with no fan that looked like it worked pretty well.