For me the biggest reason to have them is for super quick axle alignment during a race. You don't have to worry that the wheel isn't 100% straight. Just slap it in until it hits the screws, clamp it, and you're done. However, I like having them for everyday use too.

As to the original question, I don't think I'd do it. IMO it would be near impossible to keep that hole straight.