I have run in's with motorists all the time, who cares. The problem here is the guy is your neighbor and you have to live with him.
Try to talk with him, get to know him better, maybe even ask him to go on a bike ride with you.
Better than having a run in with him a couple times a week.