How many hundreds of motor vehicles were able to pass you safely without incidence for every one jerk who honks at you? You're not the problem.
In these times of Covid, the popularity of cycling as jumped so either the guy has been hiding in his bunker the last eight months or he's just a common road rager yelling and honking at everybody in front of him.
Get a rear-facing action camera.