That hasn't been my experience. Could it possibly be something like hand lotion causing the problem?

My hands, typically, see nothing but soap and water, and I've never had a problem - and I've been on some real sweaty rides....