Don't train with symptoms of a respiratory infection. You'll risk losing far more by making it worse than you would by taking a few days off the bike. A small delay in your traing, especially during your recovery week, is inconsequential.