Grab the entire brake caliper in your hand, rotate it until isn't centered on the rim. If it rotates too easily, tighten the 5mm mounting bolt that attaches it to the frame.
Make sure you have the wheel fully seated up into the dropouts and the qr fully tight.