Keep a plastic shopping bag or small trash liner with you. Takes up little/no space and keeps clothes and valuables dry inside your bag during weather like this. Even if you don't ride at night, it's a good idea to use a front and rear light of some sort, which increases your visibility on rainy days.