I'm significantly more exhausted after a century or randonneuring event than I am after a tour ... but then my tour daily distances are usually less than what I might do each day of a weekend while training for a longer distance randonneuring event.
I do get tired during a tour sometimes, and if that happens, I try to take a break ... take a few days off cycling, relax, wander around the area on foot a bit, etc. And I try to plan my tours with lots of room for off-the-bicycle breaks.
On tours I also try to eat well, drink well, and get lots of sleep. It sometimes takes a couple days to get into an eating or sleeping pattern, especially when flying into a new country. So it seems to help to plan a couple off-the-bike days right at the beginning of the tour to get my bearings and collect the food and liquid I need for the first day or two of the tour.
But what a couple of you are describing sounds a bit like post-tour depression.