Colder grease increases drag on the shift cable/housing.
Shifts to higher gears rely on a spring where the low shifts have a positive pull.

It's a maintenance issue.
If not bad, sometimes that an extra click won;t bother low shifting, but allow "tolerable" upshifts.

You could also try spraying something like Tri Flow in the cable to "thin" the lube.