The problem is to the resale value and the aesthetics. The head angle probably got pushed back 30' if that so the handling variation is probably not enough to notice unless you rode a perfect same size example in a back to back comparison.
That written, I had passed on a number of bikes (some really interesting) due to this type of damage, so for me is collapses the value a lot.