Originally Posted by
RubeRad
The caliper should not be able to rotate back and forth by hand, should it? The rear one is quite firmly in place
That is correct. You'll need to snug up the bolt that holds the arms. This is independent of the nut that holds the caliper to the bike. Removing the caliper from the bike may help you to figure out how to do it.