I get the same thing. When my hands go numb, I just roll the warmers down for a few minutes. If I know it will be cold all day, I wear a long sleeve jersey instead. Some of my jerseys do the same thing, too - a quick snip of the elastic cures that (but would kind of ruin the arm warmers).

JB