For what it's worth, my wife and I and the friends I know would never think derisively of you. Occasionally, I'll see someone that is overweight running, walking or riding and I'm immediately impressed and wish them well.
About 20 years ago, I drove a truck for a living and my weight went up to 210 lbs. I'm now 170 and pretty much stay this weight because of my cycling. You'll get there and bicycling will help you keep it off.