Ah yes I see now that I was turning it the wrong way. Saw the rule of thumb here about which way to turn it based on which way the chain is hesitating when shifting:
http://bicycleswest.com/how-to/how-t...leur-pg120.htm
I'll definitely try this to see if I can save myself a trip to the LBS.