I think that's one which is hard for other people to answer. You just have to listen to your body. I would think it's pretty well adapted to your cycling habits so I don't think you'd have to curtail your riding, just don't go crazy the day after a leg workout.

If your find yourself just getting more and more sore and exhausted, it's a signal to ease up.