I'm in the "I only wear them when it's cold/chilly out" camp.

I have a marmot rain jacket that I use when I'm backpacking/camping. Has pit zips for a little ventilation, but when it's warm it's still like a sauna in there. I'd rather ride and be wet in warmer weather.