+1 on wool or something similar. Let the gloves get wet - you'll still stay quite warm (similar to how neoprene works in wetsuits).
I wear a pair of thin knit gloves similar to the sealskinz, and they work for me down to about 7C, at which point I add a waterproof overmitt.