Jim, it doesn't matter what you thought or what you were tempted to do. The fact is that you didn't speak your mind and you didn't act out your feelings. At another time it may have been appropriate, but in that moment you did the right thing.

I believe you shouldn't feel bad for what you were thinking. We are all judgmental of others. What we do or say, or not, is what determines our level of civility, and frankly, the amount of wisdom we have acquired.