I don't do "helmet and gloves" For me it is "gloves and helmet"
I have taken fairly low speed tumbles, downhill and skittered along the road. No helmet action but my gloves were shaved almost 1mm thinner.
You don't need much contact with asphalt to skin your hands, but unlike knees or elbows, hands are really slow to heal and vital for most people for all everyday activities. My surgeon friend always wears full gloves for riding and any other activity where hands can be damaged.