I try to ride every other day. When I ride I always push myself, I never just roll along. So I feel the rest day is good for me. My first ride of the season was about 8 miles (took a break too) and now well into the season I can do 60 miles with no problem at all. I only have 8lbs left to lose to exit Clydeville.
Anyway, do what works for you.