Do you change positions from hoods to drops frequently? If you only stay in one spot, then that might be part of the problem.
What's made the biggest difference for me is keeping a good bend in my elbow. Takes a lot of effort to get use to that if you've been riding with unlocked but otherwise almost straight arms. On the flip side, you might can stretch your reach out further, but then that has it's own issues too. I've gotten good results doing either.
If your bike is maybe a tad big to definitely big for you, probably the long reach to stretch out. If your bike is supposed to be the right size, then work on the elbow bend.
But for sure, try the gloves off and see. I use to ride no gloves.