Ok... I don't think I'm understanding your problem fully.
Are you saying that, with the cable relaxed... brakes NOT applied that the left pad is touching the rim, while the right one is still away from it, and when you apply the brakes the left pad tries to push the rim to the right, before the right pad attempts to make contact with the rim?
__________________