I seem to get wetter with waterproof gloves than without.
I just use a fleece windstopper glove with a leather palm. It gets wet then it dries out.

I always wear gloves, their main purpose is to protect your hands from a skinning in a fall and I can assure you that they work. I removed 1mm of leather from my summer mitts in one slide.