The one time that I got into an ad hoc draft line, it seemed like it was the lead rider's prerogative when to drop back, rather than someone else deciding to lead. That made sense to me -- when the leader felt tired out, he would move to the left and slow down slightly, let the line pass him, and then drop in at the back. It really worked well and I enjoyed the several miles that I was in the group.