Either it has a coaster brake (you backpedal to engage it; there should be a bracket clamped to the chainstay) or it's a track bike with a fixed wheel (will not coast). It the latter case, you should have tried to put on a front brake to make it street legal. To drill the fork crown you should really use a drill press do do a good job. When you say "the gooseneck adjusts" it sounds like a Major Taylor stem on an old track bike (see image). To remove the fork you first have to pull the stem. Loosen the stem bolt a few turns and give it a good whack with a mallet. You might need a special wrench to undo the steering head. Sure would like to see some pictures.