Yes, exactly.
It all started because you needed to squeeze the brake really, really tight before it "took", almost crushing your fingers in the process. When I'd fixed that, I realized the pads were all out of whack and when I tried to align them, I lost the "grip" again... Hence my wish to get someting more simple. Maybe I'm just fooling myself, and all rim brakes are this hard?