Because a lot of dealers know that they can get knuckleheads to pay that much if they think they will go faster.

I've never paid more than 20 dollars for shorts, and I tend to ride in t-shirts

And I go just as fast and I'm still comfortable