I bought that combo some time back. The reviews are right, it's junk.
I had to fiddle with the rear light for it to stay on- the contact points for the battery had to be spread further apart to keep tension with the battery. It's okay if you're riding on MUPs, but can't say the same about in traffic. The springs in the battery holder on the front light had to be spread out a bit as well, and then the switch started having connection issues as well. And the mount on the bars isn't the best designed thing in the world, either.
As far as possible suggestions as a replacement go, what do you need the light for (to see or be seen) and how much are you willing to spend. You might go check out the
under $50 thread in Electronics for a headlight. Tip: start at the end and work your way back, as technology has changed since it was started.