Update: The problem is unique to my stem (lucky me). So it was a manufacturing defect after all. Now all I need to do is find an exact replacement.

Thanks for the link to the SF-1 Stem facing tool. It's the perfect tool for my problem. But I can't justify the $160+ price.