Mine only bothered me in the cold too, thankfully not any more.

Have you tried using your inhaler prior to riding?