sounds like the lower bearing race of your headset is toast. Time for new lower headset cup & race or just a new lower race that fits your headset model.

Matthew Panas