The expansion plug should be centered on the stem. The stem clamp bolts only need to be tight enough for the stem to stay put under hard steering imputes. Did you apply any carbon paste? Don't worry about the spacers above the stem, they're along for the ride and to proving compression transfer. In fact once the stem is set (and the headset adjustment is done) the top cap and above spacers could be removed without concers.