You need to do what is best for your own safety. None of us here can tell you what that is.
That said, I hate to see a situation where motorist think continually harassing a cyclist forced them to stop riding. In my case, I never got a lot of harassment, but I did get a few honks and dbags doing stupid stuff like pulling up beside me and then peeling out, diesels trying to smoke me, etc. After a year of commuting, it all stopped. I haven't had a single issue in a long time - not even a honk.