This happens to me pretty routinely on commutes actually. One time when a guy in an Escalade rolled up on me and told me that bikes belong on sidewalks, I told him that a-holes belong on toilets not SUVs- and then I got the hell out of dodge by jumping on a bike path.

On other occasions I've actually tried telling the people that no, actually- bikes with wheels > 20" are legally required to be on the road, but they don't believe me.