I regularly ride my road bike with 28mm tires on dirt/gravel roads. If I need anything wider than 40mm, I grab my 29er. Most of my preferred gravel-specific tires are in the 32-38mm range.

Free your mind, and your bike will follow.