I can say from first hand experience if you can take a rest day or a day off the bike then do it. Your legs will really benefit from the rest days.

I was in a motorcycle accident 2 months ago and the only way to get to work was on my bike. Well after being in bed for a month and literally doing no exercise to riding 35 miles round trip 7 days a week my legs hated it! I actually lost speed when going to work since I wasn't able to take days off. It didn't help that I had lost some muscle when I was out from the accident but now I'm doing much better since I can stay off the bike 1 or 2 days a week.

I think some people that have been riding for a long time can do that but I'm not to that level yet. Keep on riding man!