Oh here's another theory. On my go-fast bike, I tend to wear tight-fitting cycling clothes. Not only do they cause less air drag, but because of the fit, they feel more comfortable while pedaling hard. I wouldn't call street clothes uncomfortable, but I suspect the little tugging on my body here and there is a very slight discouragement from pedaling my best.