I get passed on occasion to by hard core speed road bikers in spandex. doesn't bother me.

whats funny though is when I want to pass someone I always try and do it respectfully. I don't want to make them feel like they are going slow nor do I want to invade their space.