Right, I'm not sure it's necessarily active dislike, but just the presumption that if you're in a car, guy X in front of you is on a bike, you should probably be going about 1.5x his speed. It doesn't matter what your speedometer says, let alone the Speed Limit sign.
This happens to me all the time. People give me plenty of room, and appear courteous, they just assume that I must be going really slow, when in fact, they're significantly exceeding the speed limit.