So, to tighten the threadless, loosen the bolts on the stem, then tighten the cap on top. Then tighten it all back down.

You won't be able to effectively tighten it if the spacers/stem don't extend above the top of the steertube.

There is some kind of a star nut inside of the steertube. Perhaps it would need to be pushed down further.