There should be no lateral movement. Movement is going to weaken the mounting points with possible rack failure in the future and possibly of your bike where the rack is attached. Get a different rack that will mount properly, and/or go to your LBS and ask for advice.
BTW, pics help in describing the problem.