I think you should actually ask a doctor, not a lot of cyclists who have no medical training (or no one says they have).

I understand that if the cold virus reaches the heart, you will be very ill and may die. I recall a medical student once telling me that.

I have no medical training, and don't know if this is correct, but I would not be doing the hard ride that you are proposing, just in case I am right.