In my experience, the pads are much more likely to glaze and cause brake problems.

Also, as mentioned above, perhaps you should be using your front brake more. Rear brake is so innefective that you have to drag the brake a lot more to slow down the bike. You should certainly be relying on the front brake for most (~75%) of the stopping duties.