File, including a metal fingernail file if that's all you have around.

Not sandpaper or diamond embedded nail files, since both can leave abrasive stuff embedded in the brake pads.

Even with plain metal files it's a good idea to brush them clean first if they've been used before on metal surfaces.