Photos would help as well as make/model of headset if you can determine what it is. Don't ride it until you fix it though as you can cause damage to the bearing and surfaces. Headsets are usually pretty easy to maintain so once we figure out what you have we can offer some help.