I wonder the same thing because I would like to think I am in a similar situation.
Most of my ride is done over smooth pavement, but there are small portions of it where I ride over what is 'unsmoothen' asphalt. It is like gravel in the sense that it's small pieces of points that could damage ties, but they are not loose like gravel and in fixed positions.

Personally I see a lot of road bikes go over the area without trouble, and I figure gatorskins are fine. They seem to be holding up anyways.
If I was on a CX bike, I'd probably stick the same size tire it comes in stock but find a more city. Marathons look like a good bet.