Frustrating indeed. You mention you have safety gear, but not what type. I'll relate my own personal experience in perchance it would be something you may consider.

Used to be, about nine out of ten cars passed me at a distance I felt was unsafe for me. Yeah, I could have reached out and touched the cars as they pass. Then, I got the biggest, baddest strobe taillight and an unbelievable phenomenon happened. Since I started using a strobe taillight, even in the bright sun, the ratio has flipped. Now, nine out of ten cars pass me by at least five-six feet clearance! They either go completely into the oncoming lane, or at least half way across. Only the occasional idiot who isn't paying attention to their driving, or are on some type of macho ego trip will pass me close enough that I'm uncomfortable.

In addition, I also use a bright strobe pointing front. I've had oncoming left-turning cars a quarter of a mile ahead wait until I passed before they completed their left turn. I've also had a motorcycle chase me down because he said he saw my strobe from a half mile away and wanted to know what type is was because he wanted one for his motorcycle.

I'm a believer and now do without only if I'm on a MUP or riding in a group. Good quality, bright lights are not inexpensive, but they are a whole lot less expensive than hospital bills. What price do we put on safety?