Agree that I would not look at a CX bike for a majority of gravel grinding. It will be a rough ride.

If you want to go singlespeed, check out the Redline Monocog. It's simple to swap out the rear cog to get the gear ratio dialed in to what fits you.