I'm guessing your frame is ally.
Why don't you post a pic of the brake bridge? It prolly has plenty of spare meat on it.
Remember, rear brakes don't get a whole lot of load on them before the wheel locks up... I bet it'd be fine to take a file to the brake bridge.