Yes - there are differences between brakes....just because one doesn't notice or understand doesn't mean those differences don't exist. Thinking along those lines we should all ride the same frame, components, wheels, etc.

Big difference in brake design is response - modulation - to weight. Some lightweight brakes lack modulation - so when you pull the brake they almost lock full on. Others allow so much modulation they seem telepathic and allow you to totally control everything going on. Flimsy arms make for squishy and not as responsive brakes.

Head into a crit corner at 30mph with 60 of your closest friends and watch the junior lock his brakes up....

Effective performance and racing is as much about proper braking as it is about conditioning. Ask any motorsports person and I am sure they feel the same about their sport.