If the wheel is not out of true enough to rub, continue your ride. If it causes the wheel to rub the brake pads, then open your brake's quick release to give the wheel more clearance, and finish your ride. Then be a bit careful decending because your brake may have less stopping power since the extra brake lever travel may allow the lever to hit the handlebar.