Yup.. if you can hang, you can hang. And that's nonsense about not being able to push yourself to a high fitness level on solo rides. I ride solo and have gone from 15 mph to 18 mph average in the past riding season. If you have self-determination you can get along alone just fine.
If you like riding in a group, that is fun too. But don't pretend it's impossible to train up on your own.