Back in my flatland freestyle days I found that Simple Green on a thin rag worked wonders. I'd also use the rag on the brake pad pulling into the pad.
Nowadays I just use a little warm water on a paper towel. I'm not looking to lock up my wheels like back when I did tricks, so I've not really had to clean my pads.
Good Luck!
Ben Adrian