Something other than the cap is an issue. Chris King often cites stem faces being out of square so you might look at that. In the mean time, it's just a metric bolt which hardware stores (and bike shops) will have. You should bring a part of the threads from the old one with you so you get the right size as I've seen a couple different sizes used.