That's the thing with fatigue; if inspection doesn't catch it, the final failure is so abrupt it's unlikely to be caught before something bad happens or almost happens.
In aerospace design, this is mitigated to some extent with "fail-safe" design, or at least "safe life", i.e. scheduled replacement of components with known finite service life.