By throwing out a number, you really haven't told us anything. How are you measuring drift? String test? Clearance from stays? CMM? What is your reference, are you using the same reference as Felt?
I have heard that a large American manufacturer says that 5mm is straight enough. Most steel builders try to stay a lot closer to straight than that, but there are plenty of pretzels out there that people are riding happily.