If the shifts are perfect when either shifting up, releasing cable, or shifting down pulling cable, but not both at the same time, I'd look at the derailleur. Basically you are over shifting in one direction or the other.

​​​​​​​John