The only thing that bothers me about rain, besides lightning of course, is if the rain is hard enough to limit visibility. Same for fog.
Riding in the rain, however, does give a greater sense of accomplishment.
And it's a great way to clean rims. Just spray the bike off with a hose while it's still wet from the ride.