You can, and you'll be none the worse off.

The bolts were originally intended as a racing feature, to facilitate quick wheel changes. Once properly set, you just pull the wheel all the way back against the stops, tighten the QR down and you're good. But they also weaken the dropout -- a common dropout failure mode is cracking through those bolt holes.