I get cold fingers. I tried the vapor barrier liner idea a few years ago. It didn't seem to help very much. It's easy to try, though, and would probably be good if you were out riding for hours. Insulation that's wet from sweat isn't effective.
My favorite gloves for 35-48F are some
REI Marmot shell gloves. (I'm still pretty cold under 35F.)
For the shells, I have a couple of different liner gloves in different weights.
If the temperatures get up past 50F during the ride, I can remove the lining glove and just use the shell.
I really like the long cuffs. No more wrist gaps to deal with.
My older version came with tether loops. That's pretty handy, I can pull off a shell glove and it hangs from my wrist.
It's nice to just hang up the shells after the ride to air them out, and wash the liners. The liners hang dry overnight.