Fretting is a result of riding with headset loose, so the balls had some acceleration space..

Its not a expensive part, you can now replace it.