I take off my glasses when they get foggy during rain. During snow and ice I put on tires with studs. Crashed once on black ice, that won't happen again. During the heat, I have no problem. I rode in 100F weather for 150 miles, just make sure there is enough water and a few salty snacks, banana, etc to keep the electrolytes topped off.
My commute is only 9 miles one way, so on a rainy day, i throw my rain gear on (Jacket, pants, booties) and go about my business.

I cycle year round and have fun doing it year round as well... well, there was one time where the snow was coming sideways with a very strong crosswind, that was less than stellar. But I still made it.

I just love cycling. ****ty weather is not a deterrent.