If you ride further from your home than you'd be comfortable walking back, make sure you either know how to change a flat or bring a cell phone so you can call someone to pick you up because sooner or later you will get a flat.
I think you're worrying too much about crashes. Go out and ride. Have fun.