Large or small, if you are on a bike, you will be an object of ridicule and derision. Most of the general public are clueless at best and malevolent at worst. They will mock your clothing and equipment, your physical size or apperance, they will try to run you off the road, they will sneer, hoot, holler, shout, and snort. At best you will be a curiosity in your own neighborhood.
Once you get your mind around this, It can be a very liberating realization. You will then be free to wear lycra tights, ride in the snow and rain or spend an hour or so on a Saturday pedaling up and down the same hill. Thus becoming an enigma to the uninitiated.
Let them think what they want, because they will anyway.
Dan