Many bearings with axial load not perfectly tensioned get ruined very quickly. Depending on the washers you installed it with maybe you could've been putting an odd pressure on the inner race that could cause the bearings to start to fail?