Not really, actually it's because in the early days, you had to manually change your chain onto a different gear and of course changing out your own tires meant that the black wool shorts would hide oil and grease stains.
Don't believe me, hit up Wiki