Not a problem for me at all. What I ride in is my regular summer attire. I wear a common T-shirts, many wicking, and rugby shorts. As a bent and trike rider I dont need the pretty much outlandish cycling kit. On my bent bike I wear mountain bike shoes without the clips, but I might click a little with my SPD clips when I ride my trike.

OTOH who really cares. Have you seen what some people appear in public wearing?