That silver steerer retaining shim is supposed to go under* the top black bearing cap that says "FSA" and then your headset spacers go on top of that.
Considering you fudged this up, I would double check everything else once again.