When the cords start to show or a cut or puncture is so bad that when inflated the tube makes the damaged area pooch out. Sometimes if I have ride that is important to me coming up, I might change them earlier.

I wouldn't fault you at all if you changed them when the wear indicators disappeared. Basically when ever they've gone too far for you to be comfortable. I'm willing to go pretty far, if you aren't that's okay.