With the crazy weather we've had this year I'd get very little riding done if I waited for perfect weather.
I'm more concerned about vehicles than the weather. And I'm not excessively concerned about vehicles.
Last night an unexpected t-storm blew up just as I was headed home from a nighttime group ride. I waited an hour in a restaurant for the worst of it to pass us. When the thunder delay indicated the storm was a couple of miles away and receding, and the rain let up to a sprinkle, I headed home. The head wind was around 20 mph for 10 miles but I got home okay. And I took the long route with less vehicle traffic, because I'm more worried about tired drunks on wet roads on a holiday weekend than I am about t-storms.
The worst part hasn't been riding in the storms. The worst part is having to clean up the bike afterward.