I think often the second driver gets annoyed at the first driver for taking too long to pass and takes it out on the most defenselss person available, the bicyclist.