Alright, well I guess I'll just return it then. Shame because it's amazing.

The only thing I could think of is to use a bolt to tighten the adapter to the black cap it comes with and then super gluing the cap to my quill stem. But that kinda takes away from how sturdy it was suppose to be.