Maybe I've been lucky - never had that problem.
My usual apprehension is the chances of being rear-ended by other cyclists following me who for some reason feel stop signs don't apply to them. They're the only reason I have mirrors - motorists are much less of an issue.