It doesn't matter if the frame was cold set or the wheel just "jammed in".
The result is the same.

Of course it compromises wheel strength, since it makes the wheel even more asymmetrical,
It's just a fact of life.

I've found many front wheels that are off a mm or 2.