You'll get cranky and not want relations with any woman and all you want to do is sulk and sleep. That's when you know you need a rest day or three. I sometimes crave certain foods as well. Real fatty foods.
If you have a strong desire to ride ... go ride.