It would scare me more if I couldn't hear the cars. I think you'll overcome the fear in time.