It's definitely because your head tube is so short. I doubt getting another brand adapter would help. There's probably a "sweet spot" where you could tighten it down without play.