I admit to shaving my legs for a couple of weeks once. I thought it felt different the first time or 2 I rode, but, I am relatively sure that was only mental.

If you like it, shave and dont worry about it. If you dont want to, dont worry about it.