I agree, no need to guilt yourself about it.
However, if you do want to ride without being thwarted by weather - if you wear full rain gear and don't ride hard enough to sweat a lot, then you will stay dry. "Full rain gear" means a good rain jacket (Showers Pass or simialr), rain pants, booties, gloves, and a cap under your helmet (or a helmet cover).
It rains most of the year where I live, so I ride in the rain routinely. People ask me, as I ride up in the elevator, streaming with water - "don't you get wet?" I explain that, dressed as I am, I could stand in the shower and I wouldn't get wet. I like riding in the rain, it is sort of refreshing.