So I removed the spacer and as expected, the cartridge couldn't screw all the way into the frame. I left the spacer off anyway because I was able to screw it in about a 1/16" more, and helped center the arms more. It's only about 1/8" off now and I'm just going to live with it.

Still strange that the arms would be more centered without the spacer for this BB.