Yeah, no I don't think so. How often do you see motorists get irate and horny at cyclists who are illegally riding on the sidewalk? It doesn't happen.

It really just boils down to two things:

1) Motorists don't like to have to slow down for cyclists
2) Motorists don't like to have to drive more cautiously around cyclists to avoid killing them, because that takes mental energy

Go to YouTube and watch some of the many bike vs. car road rage videos and you'll find that the majority (I'm guessing at least 90%) of such incidents are the direct result of a cyclist riding in the middle of the lane for a prolonged stretch and impeding the motorist until his blood boils. Legality is not a factor whatsoever.

If you ride a bike on the streets you will always be hated by a small percentage of drivers, but as someone else here mentioned, the "bicycle drivers" will be hated more.