It can be good to vary things. Sometimes you need recovery to get stronger so there is nothing wrong with riding a lot one week and less the next, doesn't mean your fitness is suffering and it may improve with this strategy. So, mix it up depending on how you feel. On the supported tour, what do your miles and terrain look like?