Harassment is in the eye of the beholder. I don't care if people yell, think bad thoughts, or make obscene gestures. None of that affects my ride at all.
If they do something else, I make sure I'm safe, wave, and go on.
I try to always remember what Churchill said - “You will never reach your destination if you stop and throw stones at every dog that barks.”
__________________
Formerly fastest rider in the grupetto, currently slowest guy in the peloton