Dude(tte), wish you were closer, I live in NW Arkansas and am up against the same thing, the people I've met all ride carbon road bikes and are only interested in fast paced road trips, One guy I did hook up with I drove nuts as he had to keep dropping back to wait for me or raced ahead 1/2 mile or more and sat and waited. He had planned the trip (in his head) so I was worried he might just go ahead and leave me and I'd have trouble finding a safe bike-friendly way back home. That was the last ride we went on together. I ride for fun and fitness and am not interested in top speed.
I hope you can hook up with others like you.