I use rubber bands, we have surplus at work. A helmet-mounted light can be useful if you ride in traffic:
1) it shows over the tops of parked cars, helping cross-traffic see you before they pull out in front of you
2) if you're not sure you were noticed, you can weave your bars and your head in opposite directions a couple times for the
whoa, what was THAT?!. The opposing motion of the lights is good for grabbing attention.
3) because the beam's close to your line of sight, reflective stuff shows up well. If my glasses are fogged or covered with rain, this helps me see parked cars by their reflectors. Also handy for reading street signs.
Shiningbeam has some 1AA Romisen lights. I got one, and it's actually almost as heavy as my Fenix L2D, but hey... it was only $19. They upgraded the emitters right after I bought mine

If you use 1-cell lights, make sure your charger can handle single cells.