So, I made a visit to the remain of the frame.

The wedge nut is out.
The wedge is stuck in. Wont move. Reapplied WD40.
Tried to screw the wedge nut in, but only 6mm screw in instead of 5cm. I more, I have to use some force.
I tapped the stem in and it must taken its place into the wedge as it wont turn either way, nor move now.

I will try tomorrow to tap on the wedge nut with a harmer and wood. Could not do it today. Daylight restriction applied.

Thanks you all for your help. Never had to fight against a stubborn wedge before. And I have 5 vintage bikes..
Just be patient if possible. Remember I am a newbie. Still learning.