How evident is the scratch from the inside of the rim? Unless the inside is really bad looking, I would keep riding and keep an eye on the area looking for any changes such as signs of metal fatigue. But then, I'm really cheap. The brakes will probably make noise as this spot passes the shoe. A change in the noise might warn of a change in the damage.