My son is in the same boat as you are and with his asthma he has been miserable. I was in the ER with him on Saturday as they thought it might be turning into pneumonia.
So given you could knock yourself out of action for weeks if it worsened, good choice.
I'm a firm believer given the choice of a day or two off vs out of action for a week or more, I'd take the day or two.