A dropout saver will solve your problem. Any decent bike shop should be able to install it for you and they can do the alignment at the same time.

http://wheelsmfg.com/dropout-saver.html

Retro Grouch beat me to it.