I ride on gravel roads 8 miles a day, but they're pretty hard packed unless they've just been graded, then it's hard pack with loose gravel on top.

Honestly, if I had to ride pea gravel, I'd switch to a 26" bike and mount fairly fat tires on it.