If you are getting water on your chain, might as well clean it, the chain rings, cogs and block with a brush and mild detergent and then re-oil the chain and spin it a bit to distribute it evenly. Be sparing with the chain oil. Too much and you will create a mess.