the fibers are really only stiff in tension, but in tension their stiffness dwarfs that of the matrix. The matrix adds very little stiffness, but obviously it is required for structural stability.