I replaced my stock fork with an all carbon fork and noticed a difference in stiffness, espeshilly with the test you mentioned. I have noticed little affect on the road, maybe a slightly more forgiving ride (AL bike)

I can however notice a difference in weight/responsiveness of the front end (400 gram weight savings makes a difference in the feel of a bike when it comes to the fork)