You're doing it the wrong way as most people do, you should remove it from underneath by putting a thread and screw it out, works everytime, it just say click and it hasn't failed me once with any stubborn stem.
See my picture so you get a understanding of it, just screw it out and it will click loose.