Saying you drop roadies on your bike path home is like gunning your 80s Honda at a red light against a Ferrari. And then bragging to your buddies how you smoked him with your Honda even though he had no idea you were racing.
Now if you roll along side said roadie and ask him if he wants to sprint to the next telephone pole (or whatever marker seems suitable), then he accepts and you drop him then, okay brag away. Although randomly asking someone to race can be kind of rude and unwanted to some, if you approach it in a courteous way can be fun and you may even make a friend.
You can hardly judge anyones ability based on their bike/clothes. Only the thing you can judge is about how much money they were willing to drop on their gear.