I what you said meant that shifts to smaller cogs hesitates, then that can be the result of cable friction. All that up and down stuff isn't clear.

As also mentioned, the RD alignment should always be checked when there is a shifting problem.