I listen when I am on an MUP, or a far out country road with very light traffic. You'll never catch me in Chicago or a surrounding burb with them in. I know how distracted drivers are all the time.
Even then it is only the right ear (curb side) and only at a low enough volume that I can just hear the music. I don't listen to talk or audiobooks because I know I would zone out.