I use a AAA battery powered San Disk mp3 player with a powerful little AA-powered speaker I found on eBay. Mine doesn't seem to be available anymore, but there are plenty of others listed right now.

I find the speaker doesn't distract me at all and does not hinder my ability to hear what's going on around me. At this point, rarely do I ever get on the bike without music playing.