Just remember that, except in very rare cases involving extreme negligence, it takes TWO careless drivers to make a crash.
So, as long as you are careful, you should be only susceptible to a crash involving extreme negligence of another driver (like a drunk driver running you over from behind).
Those kinds of accidents are quite rare, and, if you're going to worry about those, you might as well leave the bike at home.