Ah, that's one of the new-style ones... haven't worked on one, so I'm not much help.

Although it makes the binding less puzzling... maybe your BB is too wide for the crank spindle? Try leaving out one or both of the spacers and see if it still happens.

Easiest way to centre your cranks is to compare the distance on each side from the back of the pedal to the chainstay.