I hate my pea gravel driveway, but it's become bikeable since I ditched my 26x1.5s for 26x2.0s.
That's not the only reason I prefer the fatter lower pressure tires but it doesn't hurt. I do have generally crappy road and trail conditions. Fewer stray car parts on the trail, but more root heaves through the pavement.