if it's a team, and they are on a training ride, just say no. If you reeeeaaaaally want to join the fun, join the team.

If it's a club, out for a (open to the public) club ride, then it may not hurt to ask. It's all about common sense.