Not generally if they just yell at me, unless they were being a complete prick...

I am not adverse to hitting or kicking cars that get too close while passing (not something I do often), I consider it self defense.