Only occasionally, on steerer tubes that have smaller inside diameters down near the crown. Not necessarily on steerer tubes that have a constant ID.

Get that bolt back in, put scrap wood over it and whack with hammer.
If you have a drift punch or similar, you can try hitting the bottom with that while bike is flipped over.

And soak it with some solvents and pray for the best.