Thanks Jeff, I recently put new brake blocks on and the rim was still shaving a bit, so I guess the damage has been done. It does feel like it has a ridge along the outside, like its been worn down over a long period by the brake blocks.
If I change the brake levers, I have to change the gear shifters, because they integrated units.