You might just need a bigger hammer. Seriously.

If you're afraid to hit it that hard, try spraying the steerer tube with a cartridge of CO2 and then immediately tap it with a hammer. The cold gas might shrink the steerer tube enough that it will drop out more easily. It's worked for me.