I've had hundreds of riders draft me. The 2 times I asked them to back off for good reasons, they got pretty nasty. My wife was bruised up pretty badly from her bike accident. A dude took her wheel as we rolled by so I explained the situation and asked him to back off. He got nasty and refused so I eventually had to tell him to get the F off her wheel.

I just might move to FL where the riders drop off then say "My bad"!