I have never been pestered or hollered at while biking alone, ever. But I don't get in peoples way, and probably don't look like a "target".
That being said:
When I bike with my daughter who I tell to walk her bike across those busy 4 lane intersections (I don't trust her to ride through) ... some people actually have the nerve to start honking when they see the yellow on the other side, and she is rushing to get across before the 15s "walk" signal ends. Like they are terrified that they might have to wait a second after their green pops up!
Another time I am rollerblading with my daughter across an indicated pedestrian walk, and some lady yells out of her window (when she has to stop), that we should cross at intersections!
Or once my daughter was sucking on one of those freezee popsicles, and some guy yells out of a pickup truck "call me when you are 18". Part of me wanted to chuckle, part of me wanted to kill him
Either a coincidence, or perhaps peoples bullying nature is triggered when they see a female/child.
Then again, the vast majority I find to be very polite, even waiting at a stop sign for a few seconds holding up traffic, if they even see me with a child approaching. Just some bad apples I guess!