I'm revisiting this problem again since the shim that I glued on has fallen off so I'm replacing them. The play hasn't increased much since my last post which was around 2,000 to 3,000 km ago of loaded touring. But I did compare it with a brand new Mu hinge which is similar to the Vigor/vector hinge. The brand new Mu has no play.
On my frame, unlatch the hinge, it appears as if the boreholes have ovalized, allowing the main pin to wiggle around. The amount of movement is very small maybe around 0.2 mm. I still can't get the retaining pin to come out, as it's probably gouged into the cam or slightly bent so I cannot disassemble to check. I thought about cutting through the retaining pin to extract it but there is a risk that it's stuck even after cutting, leaving an unusable frame so I have not done it.
But I thought I saw the main pin rotating freely in the borehole where it's supposed to be a press fit, when looking through the hole at the bottom. Possibly the press fit borehole has ovalized and is no longer holding the pin.
I'm just wondering at what point would it be unsafe to use? Chat AI keep on telling me it's extremely dangerous like I'm going to die or something.
Does anyone know if the upper main pin has the hole where the retaining pin goes into, whether that hole passes through all the way to the other end? I want to know if I tried to cut through the retaining pin whether I can tap it out from the top if there's a hole there. If not, I won't try because of the risk of it getting stuck inside the hole.

And even if I could remove the retaining pin, is there any point, since there's no way to repair an ovalized borehole? Does anyone know if this main pin is actually pressed fit or perhaps threaded? If it's just threaded in, perhaps I can simply tighten it, But I think that's unlikely.