Yea, when i get back from my ride today i will probably take the whole brake off and see if i can clean it up and see if that helps.

this is the type of brake i'm talking about. (and reaching back to push down the arm isn't all that difficult.. but it is kinda close to moving parts so i'd rather not)