Lately, something hasn't been right with my rear shifter. When I shift up (to smaller cogs), there is sometimes a 3-5 second delay between me pushing the lever and the actual gear shift.

This problem does not occur when shifting down to lower gears (to larger cogs). Only when I shift up.

What's the problem and what should I do? I'm thinking of taking it in to the bike shop today.