Wrist and hand nerve damage is serious (and as LeeG points out, it's damage, not fatigue). Your body will work to repair the damage when you get off the bike, but you're doing yourself cumulative harm that may contribute to bigger problems down the line.
Is it going to last? No, it will get better. But if you're looking forward to a lifetime of pain-free cycling, now is the time to start figuring out what combination of handlebars, gloves, and fit adjustments will let you avoid abusing your hands.