I assume your bike has centre-pull cantilever brakes. Are you using the stock brake pads or have you switched to something better?

Another option is mini-V brakes, which have good stopping power and are easy to set up, but take away some of your clearance for fat tires and fenders.