Not to presume anything about how much, and in what way, you and your coworkers have to interact with this guy, but it just doesn't seem worth it to engage him. Oscar Wilde he ain't, if that's his idea of a hilarious put-down. I think Dwight Schrute could do far better.