If it is shifting correctly and nothing seems loose, wobbly or different in it's behavior, then consider it adds to the character of your bike. Whether that is a negative or a positive depends on the individual and sometimes circumstances.

For my everyday riding enjoyment, I would not care about scratches and other aesthetics. If I were going to use the bike for promotional purposes I'd probably want it to look piss-perfect.

Of course sometimes the true damage might not show up till many miles after the incident that caused it. But will you be better to replace it now or wait and see if it makes it half a lifetime as opposed to a full lifetime?