I've had the same kind of worries, although I had a bike that had significant rust. I finally lost confidence in that frame and built myself a new one. It's really difficult to judge the condition of a frame like that, but in the absence of rust I don't think you have much to worry about. I have thought about using an ultrasonic thickness gauge, that's big money just for an inspection if you don't have the equipment.