Deer looked like he deliberately knocked the guy down the way he jumped, as if he was trying to defend his territory. I don't know what you can do to prevent that kind of thing, other than castrating all the bucks before rutting season.
I've seen hunters that had doe scent on them that had much worse things happen to them, but I won't go into details there.