Tried the center punch... it helped (with the shims), but nowhere near tight by itself. It was difficult to get both shims in however, so it is tighter than before. I may talk to a machine shop or two to see about the permanent shim. Or I may try JB Weld.
Has anyone on here done that before? I was curious as to what the right procedure would be on doing that.