If you want to remove rust, you will need a solvent like WD40. After applying the solvent, clean well. Then lube. I know that some people NEVER use WD40 and I would agree that you should not use it as a lubricant; but you need it as a rust remover. If the chain is badly rusted, replace it.