As Doug points out, it's not good. As a frame builder they see more than their share and often have to break the bad news to folks that don't want to hear it.
I have seen the worms find a weak spot that remains undetected until it was really bad. It can go inward and not seem bad, then the pinholes show up.
There's usually more than you think once you start looking for it, way more.