Reminds me of the time last winter I was touring through cold-ish but extremely wet weather up in Northern California.
I was completely unprepared in the gloves department. I was using a set of PI P.R.O. (water-reistant) gloves that were not up to the task and I was miserable. In a dire attempt at keeping warmth I bought a set of rubber kitchen cleaning gloves. They did almost nothing. My hands were neither warm nor dry
I imagine latex gloves would have a similiar problem in keeping the water from entering through the wrist area.