Well...because rubbing slows you down. Sure, not a lot, but it does. Same thing with extra weight - not a big deal, but every little bit counts.

This is coming from a XC riding/weight weenie perspective...carry on.