You don't want to remove the adjustment screws because then you'll have to recenter the wheel every time you re-install it. Their purpose is to provide a single, reliable, repeatable position for the axle, so that wheel changes can be done on the fly without having to fool around dialing in the position. Vertical dropouts do the same job eliminating the need for the positioning screws.

BTW- when these were in common use, one problem is that with normal (somewhat rough) handling these would get bent where they stuck out behind the dropout. This was a problem because they couldn't be moved or removed without damaging the threads in the dropout. When I set up team bikes, I'd get them perfectly adjusted then saw off and file smooth the section outside the frame. If need be they could still be adjusted or removed from the axle end, but no more damaged threads.