I never changed mine until one day I was commuting in traffic and a car made a turn without looking. Grabbed the front brake hard... SNAP... grabbed the rear brake hard.... SNAP. Both cables snapped when I needed them most. Lucky for me I swerved and didn't get hit.
Here is a picture of what happens without preventive mantainence....