Well if you have to pull the bottom bracket out to put the spacer in try fliping the spindle in the cups first and see if it corrects your problem.

Tony