Definitely swapping the Kool Stop pad spacers using the thicker pad spacer on the inside of the caliper will improve braking as Bianchigirl suggested. As the the slotted part of the caliper goes beyond parallel with the rim you are losing leverage.