Thanks guys, I smacked the allen bolt and the wedge nut came loose, after that it took half an our of twisting and pulling but I got the stem out eventually.

Cheers.