They could have been calling you sexy? People have all sorts of fetishes these days and maybe grey sweatpants is the new mankini

I had a car of people yell "ROADIE" at me once while I was dressed in non cycling clothes on my touring bike to pick up groceries in winter. That as far as I can think was the funniest thing that has been said. Had one guy say I wasn't allowed on the road and he kept going down from there but that ended with me running home to get another bike to chase (this happened super close to my house) because he was a private car service and thought he might be going nearby but didn't and I ended up getting some tasty onion rings instead. Way better outcome.