I have a can of that stuff, Permatex Rust Restorer, spray it on and it kills the rust and turns it black, but I still like to get rid of as much of the rust as possible first to make sure the metal is still sound.

And if I can get rid of it all without needing the rust restorer, so much the better.