Jonathan,
I've had plenty of those kinds of remarks while exercising my legal rights to use the road. Still, 99% of the motorists are friendly to me, even helpful.
I've had enough experience to know that, if life teaches and corrects me, it will do the same to others who need it.

Pete