So when is your next turn as sweep rider?
Sounds like the least that should be done is an "inspection ride" in the parking lot, where the new riders could just do a couple of laps to test their shifters and brakes. That way you might spot riders who don't know what they're doing as well as bikes that aren't working right.