You only have one pair of shorts and you've only worn them once? When you've worn out several pairs of shorts and tires (I mean worn out... no tread, threads showing) maybe you will start to relate to the cycling subculture.
The "us verses them" mentality I feel is generated by the rebel nature of cyclists from always being referred to as "crazy" or "something I wouldn't do" by your friends, neighbors and coworkers... and of course from motorists honking at you, yelling at you, and generally treating you "differently." Before too long (a year or 5 or more) of regular commuting and generally riding a bike all over the place instead of driving, and lo and behold... you are us, and they are them. While you may try to be nice to "them," and your non-cycling friends tolerate your peppy energetic arrival at group events, the increasing mental gap in your way of thinking verses the thinking of the non-cyclists will further foster that us vrs them feeling.
Suddenly you may find that you seek more of "your own kind" and begin hanging out in bike shops, coffee shops and going to bicycle events. What can I say... it happens. Suddenly the price of gasoline is no longer important to you, and you may decide to sell your old car, so you can put more bikes in your garage. You then discover the n+1 phenomena of do I have enough bikes. And so the conversion continues.
At this point you may find you have signed up with one of the bigger on line bike shops and are having shorts sent on a regular basis to your house... to support your habit.
You may start seeking work that along a good bike route or a great path, or perhaps you just commute "the long way" to your current job. You're hooked. Maybe one of your old friends ribs you about your cycling "habit..." and you turn to them with disdain and spit out the word "cager."