I sometimes wear them when on low/no traffic roads, or fire or logging roads or while trail riding. I have tried to wear them when riding on roads where cars do go and I always wind up distracted and drifting to the middle of the road just as a car is approaching from behind.

THere are definitely risks involved in wearing headphones in traffic. You have to make up your own mind.