Keep it up for sure! I am one of those lycra spankys on my longer rides, but on my commute (a 32km round trip) I wear normal street clothes. I don't have one of those ultra-expensive bikes.
The thing is, I lose nothing. Heck when one of them passes me, it's "expected". When I pass one of them, however (which seems to be happening more and more often), I get a hell of a lot of satisfaction out of it. The longer you commute, the more it will be that way for you I expect.
Chris
__________________
I am clinically insane. I am proud of it.
That is all.