I think you should just ride naked!!
Or get a recumbent. <begin flame wars>
I wear bike shorts simply because I've found them to be more comfortable on a bike, regardless of whether I'm riding the 'bent or the DF. I have 'bike shirts'...not jerseys with logos or anything like that, does that count? I wear what's comfortable for me, and don't worry about how cool I look.