Maybe he was just pissed off that you were keeping up on a mountain bike.

I wouldn't draft a stranger without notify them or asking them first. IMO, it's a little rude and can be dangerous. I wouldn't want a dangerous or inexperienced rider to try and ride on my wheel.