In the last several years allergists have found that exposure to latex rubber can act as an allergy "enabler". By that I mean that exposure to latex can precipitate heretofore unknown and unsuspected allergies.
Based on your comments, you may want to be tested by an allergist. The understanding of allergies has had tremendous growth in the last 10-15 years.