Burrs left inside the steerer tube , I see, so there may be also burrs on the outside.
remove the part in the top picture and clean up the cut edge to remove the burrs .


a 6" long half round file should be the tool to use..

though a Carborundum grit paper or cloth and a wooden dowel and flat stick

as a backing for the abrasive will Do.