was he joking?
one day while i was out riding, i passed a couple on fixes on a hill. a while later, they passed me. as they passed, i said, "yeah, i knew that was going to happen". i was joking around and they laughed.
sounds to me like your guy was might have been joking about the fact that he was being passed.
j