As a mater of fact, there have been times in the tour when the race "leader" is ordered back to the team car and stuffs the yellow jersey full of water bottles to be taken up to the "real" team leader.
Domestiques end up in yellow sometimes by happy coincidence, but it doest turn the team on its head.