Wifey tried latex last year - she didn't like it. Then again, we were using cheap cotton gloves, so that might have been the issue.
Dottie from Let's Go Ride a Bike suggested wool glove liners under waterproof mittens. She lives in Chicago, which they tell me is cold but I've never been.
M.