I'd suggest that you ride for a day without any gloves. have found in the past that padding can aggravate my finger-tingle because it tends to squish all the nerve through the hand.
I've also found that the stitching on some of the gloves I've has cut across the nerve through my hand. That's why I am suggesting you might ride for a day without gloves to see if this is an issue.
Rough roads are always going to cause an issue. What pressure are you running the front tyre? Can it go any lower? Try to relax your hands on the grips as much as possible, rather than clamping tight, which is a normal reaction on rough sections.
Finally, follow Chris Pringle's procedure on checking to see if you can lift both hands off the handlebars when coasting, without feeling if you are slipping forward on the seat. Pressure on the hands indicates that there is something amiss in your saddle fit, and often if can be only a centimetre out.