His threat, however lame, puts him in the wrong job......
He should not be allowed to have the responsibility of the safety of other people's children. He just proved that by his actions toward you.
He should be reported, so it can be resolved. Either through education, or dismissal.
If he gets away with it - it will embolden him to act that way to others. That's what bullies do, and what he did to you.
Don't let it slide, it's serious.......