Remove the off-side tensioner and save it for your second bike. You really don't need two. Only thing it does is help you center the wheel when you lock up and that's the easy part.
Make sure the part of the KHS that slips into your dropouts isn't thicker than the bike frame metal. If you've got a Pista or some other frames, that chunk will prevent the washer from sitting flat against the dropout. You can either bend the axel trying to tighten it, or it'll loosen easily because the washer's not sitting flat. The Surly tensioner doesn't present that problem.
__________________
Location:Thetford, Vermont