Up until about a month ago, I wore my prescription sunglasses.
I was on a trail ride in some heavy, heavy rain. My glasses were a mess and I'm blind as a bat without my glasses. The trail I was on is a difficult one when it's dry out; however, it was very entertaining when I can't see and it's wet.
Now I wear contacts and regular sunglasses on my rides. If it gets too nasty out, I can just take off the glasses.