How true is the rim? You should be able to have plenty of pad clearance/travel at the lever and still feel right if the rim is centered and trued nicely. If the rim has any wave to it then that adjustment margin is eaten up.