Thanks guys, I might try rigging up a tool at some point. I guess I was tightening them wrong, I assumed that the cap was a locknut and you were supposed to tighten the screw to the inner nut and then just tighten up the locknut to keep it from loosening. I'll try clubman's method or try to pick up some blue locktite for next time I need to adjust them.