HE was wrong for his response. But I think you are wrong to be in the thick of things on a group sprint on a tandem. Sure - points mean nothing. But we all go for them. The little bit of competition is what makes a group ride "more fun".
You are on a tandem. Everyone else is not. If you were on a motor cycle blocking the riders they'd react the same way. My advice - get some regular bikes if you want to contest the sprint -- or hold back with the other tandems (or peg it and get away from them) and have your own sprint.
And one more - make sure the next time you take a drink and he's behind you to spit some water/phelgm over your left shoulder so it hits him in the face!