You have to remember that the material that provides the protection in a helmet is expanded polystyrene (AKA styrofoam). If you have ever played with an old styrofoam cup you have experienced just how brittle and nasty the stuff gets with age. Considering the cost of a new helmet vs the value of your head, every three to five years sounds about right.
Scott