If my glasses get rain spattered or fogged to the point I am having trouble seeing I take them off. But then, my vision isn't so bad I can't ride safely without them.
Riding on a foggy night without glasses is fun. It's like riding through... The Twilight Zone.
http://www.youtube.com/watch?v=NzlG28B-R8Y