I don't like it a bit. The idea of having two clamp bolts is to increase the area under clamping pressure (and add redundnacy). What you propose seems to me like you are "stealing" clamping pressure from the stem and using it to uselessly clamp the spacer. If oversize, the spacer could conceivably compromise the clamping ability of the lower bolt, too.