Shouldn't you be concerned that he was actually keeping up with you a while since he had a MTB and you have a road bike?
Not sure I would want to tell people I was pushed to really going flat out by a MTB...
I am sure a guy on a motocycle could blow you away, different equipment - different results. I am more impressed with the MTB rider. He is probably chuckling that he got you to really dig in. The fact you should be able to beat him is a little obvious, don't you think?
Shoot, if I can keep up with a car for a block or two I feel pretty good - if the car (or a road bike) drops me, well, sort of expected. Nothing for me to be ashamed of.
But imagine how you would have felt if he managed to drop you!