I took a slide along the road once, and skimmed 1mm of leather off the palms of my mitts. Imagine the damage to my hands if I was mitt-less.
Hands are pretty essential for most activities and one of the slowest parts of the body to heal. Wear gloves.