Not many riders here, so usually I only get passed on organized rides, on the first half. I check what gear they are in, their form, and sometimes notice the bike if it has a level top tube and non aero levers, or is in some other way different than the standard new bike. Then as the ride gets closer to the end I start passing 50% of the riders who blasted past me at the start. Some work to stay ahead or pass me again, but most are blown by that time. The fastest riders are gone from the parking lot by the time I get in.
I've actually wondered what a cyclist who passes me outside of a charity ride thinks. A "fred" with all the latest stuff they were told they needed in order to ride a bike, passing someone like me, who might be wearing a fishing shirt with lycra bike shorts and either quill pedals with sneakers or my nashbar spd sandals with big thick wooly socks, and what is pretty obviously a bike that is older than thirty years might think I was either very poor, eccentric, or just a nerd out in the middle of nowhere on a crappy old bike.(Not always dorked out like that, usually its a soccer goalie jersey or wool sweater with cleated shoes, so I'm still not sporting the usual billboard look)
I have no personal frame of reference to judge "freds" by, because riders are pretty rare here and in all my time riding only one person in full kit did not wave, and as he was going about fifty down the hill I was spinning up that was fine.