you are still only on the bike for 10% of your day. I'd look into what you are doing off the bike for the other 90% of your day to see where you are overextending yourself.
Your recovery begins as you get off your bike from that day's ride.
nutrition, massage, sleep, mental relaxation....