Since I didn't have brush or steel wool around, I tried a piece of scotch brite like material (green one) - it is a circular one I bought to remove stain from the shower glasses.
Worked nice