Look at it this way. If you went for a Saturday ride of 30 miles, you wouldn't stop and change shorts halfway through. What's the difference if you go for a 15-mile ride in the morning, and use the same shorts for another 15-mile ride in the evening?

It certainly simplifies commuting to wear the same clothes home that you wore in.