I generally only use "On Your Left" when I am using a bike/foot path. It helps keep things safe on the narrow area, however I have stopped saying it to older people on foot, because it generally makes them nervous and they freak out.