Yes, weight itself doesn't affect performance, but if a manufacturer obsessed with weight makes an arm with too little material, it will flex. This makes it difficult to modulate because you start squeezing the lever and applying the brake before any real pressure is applied. It's a minimal difference, but one I have definitely experienced. In my experience, all dual pivot Shimano and Campagnolo brakes perform about the same. The cheap no-name or low end Cane Creek and FSA brakes are very squishy and difficult to make small adjustments. The super lightweight ones like Zero Gravity also feel squishy.

That being said, I have never felt unsafe because of a caliper. You just have to leave a little more room for error with some if you're pushing the limits of speed and cornering. I have, however, had a pad feel so terrible that I wondered if I'd ever stop.