Put the wheel on and tighten the quick release before you adjust the caliper angle and that should take care of the problem.
Don't forget to tighten up the caliper before removing the wheel.
Once it's all together and all, the caliper should hold it's position well and so you should be all set to work properly when the wheel is on.