I probably would've either waited until he pulled out on his own or maybe said "go ahead and pull out early" if you were trying to meet a goal in some century or event. Actually I've never yelled at anybody other than saying "nice bike" to a guy walking his bike up a hill in a century
......My young impertinent moment when I was in some kind of better shape. That's a pretty fast pace in a headwind and anything should be expected go with the territory in a group that fast though.
He would probably burn out if he tried to cycle through another turn. You might've done him a favor. He probably would feel embarrassed to join you after the ride. If he did I would've tried to explain it to him somehow.