My best guess is that your rear shift cable tension is slightly too high. The fact that the bike down shifts (to larger cogs) readily but upshifts (to smaller cogs) sluggishly tells me the cable needs a slight bit more slack. Try turning the rear derailleur's barrel adjuster clockwise 1/8 turn at a time to see if it improves the upshifting.