I've re-upped the pictures, hope it's clearer now.

Yes, I use the anti-rotation washers from the original wheel. The problem isn't that the cassette is misaligned to the frame/chain stay.

My problem is that the two parts of the cassette, the pulley and the bracket, do not line up the way they should. The pulley seems to be in the position of 6th gear, leaving very little travel, instead of the completely relaxed position it should be in.
If I line up the yellow dots, the pulley will not fit the driver like it should, and I cannot get the fixing ring on when it's like that.