Super fine steel wool can also do well, depending on the severity of the rust. Easy does it, of course.
I'd agree that naval jelly might be a bit much for what you need.