Try it. I rode 38c for a long time on my cross bike and recently switched to 32c. I like 32c tires better than 38c on the road but it sounds like a 38c may be ideal given your riding conditions.