My daughter almost got herself killed because she was nervous around cars and was glancing over her shoulder. She rode off into a shoulder and almost got flipped back onto the pavement in front of the car. I'm developing a bad habit, too, with my rear view mirror, glancing at it when I should be looking straght ahead.
So....remember 1) accidents where bikers get run over from the rear are actually pretty rare (it's more often from not being seen at an intersection), and 2) the bike will go whereever your eyes tell it to. When in doubt, focus on your intended path and trust that the cager behind you doesn't really want to be bothered by having to fill out an accident report.