Something is seriously wrong if the pads are truly rotating when you brake. Are you sure the brake itself isn't loose causing the movement you are seeing? If the brake is tight, I'd take things apart and make sure there isn't severe wear on the brake arms or something wrong with the studs on the pads that prevents you from fully tightening the pads.