All hardware has too be removed if you plan on doing a decent job. What sort of headset is it? Without a picture or a proper description of the bike it isn't possible to tell you what to do