I think there have been some theoretical results showing leg hair is more aerodynamic. If you are familiar with turbulent boundary layers, that was the reason.

But your exposed leg skin is such a small area (just the knees and calves really) I cannot imagine it would make any significant difference.