If tension is pulling your FD into the chain, then the problem is that your tension is set too high. The screw is just a stop the RD pivot hits. If it is pulled away from the stop, then the screw has zero effect, and is not what is causing your problem.

Limit screws are exactly that - limits. The do not replace correct tension.