A pic would help in determining what you are removing.
Are you trying to remove the handle bars from the stem or remove the stem from the headset?
What type of stem do you have?