The retaining pin is on the rear end of the pad, so to dislodge them through braking, the bike would have to be going backwards. Seems strange to me. Perhaps something is wrong with your brake blocks or maybe your blocks were installed backwards? I just can't fathom how they'd fall out on their own (even without the pins).