I ride crappy chipseal every day on 700x32C. I wouldn't call it comfortable, but even with 26x2.125s on my previous utility bike it was rough.

Personally, I'd go for a CX or touring specific bike, or any solid road bike that can take 32 or 35mm tires. A suspension fork soft enough to do more than keep your elbows from hurting after every pothole is going to be too mushy to ever feel right anyway.