if it really is only a few mm, you can just take a file to the brakes. There isn't much stress on the material below the brake pad, so you can safely remove a good bit.

a picture would be helpful to make sure that is really the issue.