Cables don't stretch all at one time. The OP seems to describe it this way. I would guess it takes a lot of pulls on the brake (typically over a few days or weeks) to stretch them so that you could notice. I would bet the farm on the cable slipping in the anchor bolt.
jim
__________________
Cross Check Nexus7, IRO Mark V, Trek 620 Nexus7, Karate Monkey half fat, IRO Model 19 fixed, Amp Research B3, Surly 1x1 half fat fixed, and more...
--------------------------
SB forever