Remove the faceplate from your stem. Clean the bars at the clamping surface, as well as the clamping surfaces of the stem, then lightly scuff with some sandpaper. Wipe with a dry rag, then put it back together, tightening all bolts equally.
To the guy that suggested a hammer, I hope you were joking.