Many people bring up the "f*ggy pants" or "gay-a** pants" issue with me, almost all of them think we wear them to look cool.
No matter how many times I tell them that they are constructed for comfort, etc, they don't want to hear it. The simple thought of a man wearing spandex shorts is so taboo among the general population, there is no point in explaining.
Smart cyclists listen to others' experiences and try them out. Just about all of my old riding buddies have a pair.
I will wear them when I am not riding to mingle with anyone other than fellow cyclists.