Specialized used to make something called "Slim Shims" to solve this problem, ask your local Spec' dealer if they still have some, or search the web - it appears that
Evans has them in stock still.
But I agree with what was mentioned above - if it is not hand reach that is the problem, and is instead brake tightness caused by pad wear that is the problem, then it may be just a simple barrel adjustment that is needed to fix your problem.