Just my opinion. I don't think weather, exposure to cold, breathing cold air, or sweaty clothes have anything to do with getting sick. I also don't know if riding in the cold strengthens an immune system, but I am not a doctor.
I wash my hands, wear a mask in public, exercise (including riding in cold weather), get restful sleep. Haven't even had a cold in over three years.