I once had a mild cold (wasn't bedridden, no cough, and no fever), and felt good after five days so I went back to the bike and the gym.
Two days later I was in bed with a nasty chest infection and a bunch of antibiotics.
I couldn't train hard for another month.