Depending on how my morning was going, the GFY comment might have been the last thing he said, before asking me to take my foot off his throat. Then again, I'm a bit of an a$$ sometimes.
I think your way of handling the situation was far more appropriate.