You have to work out the schedule, of course, but what worked for me was to go out and hammer with the fast guys on the club ride in the morning, then shower, change clothes, and ride with the slower rider(s) at their speed in the afternoon, which was excellent recovery ride speed for me.
Rick / OCRR