I'm generally pretty cheap and will ride tires longer than most, but it seems to me a loss of rubber like that might indicate dried out rubber that might start falling apart all over. If the tire is not actually that old, and that rectangle was chopped out by a piece of glass or something, then I think you're OK. But if you've had the tire for a long time (years, 1000s of miles), then I'd think about replacing it.