Rinse with water after each ride. The water left over in a bike bottle, if any, is perfect. Just squirt it on the pads and straps when you get off your bike. Done.
If the helmet is bad now then just bring the whole thing into the shower. Again, done.
-Tim-