Safety issues:

Braking. If rim brakes, and especially dual-pivot rim brakes, it just ain't working right off-center. Brakes are a primary safety system, brakes need to work.

Quality control. If QC is so bad forks 2mm off get by there are lots of other QC issues with that fork and with that frame.

This bike is going to pull to the side and it's going to pull to side strongly under braking.

Aligned frames ride different and better than non-aligned frames. It's carbon, so we're supposed to just accept that everything is wonky?