If the problem is that you cannot DOWNshift easily, then you'll need to TIGHTEN that barrel aduster to add a bit more tension to the cable. Turn it so that it backs some threads out from the part its screwed into, try it and repeat if needed. If it starts UPshifting poorly, back it off some.