Yes, you may have a rim that is not true. You may also have something wrong with the QR or how you are applying it. Try applying it when you have inverted your bike and see if it does the same thing. Then try it when the wheels are on the ground but have someone apply pressure downward to ensure that the hub is solidly in place and not moving out of position.