I always race with gloves.

I only train with gloves if the temperatures are below 15 degrees Celcius or above 25 degrees. When riding without gloves in hot weather I find that it is isn't very practical to wipe of sweat from my head with an even more sweaty hand.