Wow, thanks for the quick responses.
Sounds like there are a couple of things I will try. First I will start wearing some gloves, I hate wearing them but I do have some from mtn biking.
Secondly, I checked and maybe I could try a slightly shorter stem. Plus that gives me a good excuse to go shopping at the LBS.