I've been 220 of bigger my whole cycling life.
I don't get yelled at often.
Aside from a few asking for directions the only time I remember being yelled at was when riding in a group where one of the guys was a very fit cyclist. I'll put up with wolf whistles and shouts of 'I want you inside me' from pretty young girls any day.