I agree with well biked. I'm guessing that you flip your bike upside down to replace the wheel. If that's the case, you have encountered a common problem. Try setting your bike on it's own wheels, then release and retighten the quick release. My bet is that'll fix it.