Riding with any group will always be a compromise. What's fun is subjective. For many, working at being faster and impromptu testing of themselves against others is fun. I haven't yet been on a group ride where that doesn't go on. Solo riding has it's charms too.