I know what you mean. My LBS runs a shop ride called the Monday Night Small Ring Ride that's billed as a recovery ride. Mostly it's racer chics in their 20s and me. I keep up.
Well now that is a different story. You have a whole different reason for wanting to keep the other riders in “sight”.