As said it doesn't make a lot of sense to me that gloves (especially cycling gloves) would help with nerve damage. Maybe weightlifting ones with wrist straps. I'm like you I never have worn gloves cycling except for temperature reasons (below 40F is about the place I need gloves and then I have some regular winter type gloves (cotton)). On a very hot day my hands to get a bit sweaty and gloves might help IDK? And on a very very long ride they might as well but I haven't gone longer than 4 1/2 hrs and my hands were fine for that.

If you are comfortable without I think you are fine. Wearing them for falls...well I don't ride with the intention of falling and if it happens there is no guarantee that you will have time to break your fall with your hands (and maybe break your wrist?) . When a minivan last ran me off the road, my hands stayed on the bars and the road rash was on my elbow and shoulder...minivans hate me