I follow the rule, ride a cold, rest a flu.
I've rode with a bit of congestion and runny nose before. I usually just follow my gut instinct. If I've got a bit of cold and don't feel like riding I don't. I'd rather not make myself worse off. If I've got flu bug, forget it. Stay at home down some Ny-Quil and get some sleep.
But it sounds like you've got something else there. If your not sure, always better to have doc check it out.
Hope you feel better soon.
__________________
"No drug, not even alcohol, causes the fundamental ills of society. If we're looking for the source of our troubles, we shouldn't test people for drugs. We should test them for stupidity, ignorance, greed, and love of power." -P.J. O'Rourke