I've been using a hard drive player (Rio Carbon) while I ride for two years. I have a "belt clip" and clip it to the waist of my shorts or tights. No problems. However, I wouldn't attach it directly to my bike.

That said, I'm thinking about replacing it with an 8GB iPod Nano (flash) player.