The pit zips made a huge difference for me in cold weather. And if it's over 50F I just get wet, don't care that much because yeah, it's harder to dress for warm rain than cold rain.
Ah, I considered wearing SealSkinz with sandals, because they're too warm otherwise, I will need to try that.
And generally I dislike riding in the rain for the same reason too: fogging glasses. Also, people don't know how to drive in bad weather and I feel unsafe riding in rain because of that too.