Is it possible that you've stripped some threads?

Perhaps pull everything apart and take some photos.

Typically the headset has a threaded upper race (cup or cone), plus an optional spacer plus a lock nut. Adjust the race, then tighten the lock nut.