Thanks for the suggestion!

I had heard of a cleaner called, "zud" which contains Oxalic Acid, if this doesn't work, I'll pick some of that up, get a toothbrush and make a paste with it. Then try scrubbing it off.