Posting in this old thread to offer some advice from personal experience. If your caps are on tight, and mine most certainly were, then there is basically no way to effectively pry them without damaging the cap itself. I tried and knife and gentile, progressive prying around all sides, but the only way to generate enough force involved deforming the caps to some extent.

So once I got frustrated enough, and the cap was already considerably damaged (luckily I have a replacement pair from a cheap second pair of these pedals I bought), I simply decided to get very aggressive. I left the screwdriver as deep in the little slot (the one that is always visible from the start) as possible, and simply hammered at it. This will put a nice little gouge deep in that slot, but the cap will come off and the damage will basically be invisible once the cap is put back on (as opposed to damage around other parts of the cap from prying that cannot be hidden).

To test this technique, I did the same thing on the second pedal from the start: just got the screwdriver end in, prying ever so slightly to get it in nice and deep, and then hammered the end of the screwdriver with repeated low-force blows. The cap popped off and the damage was as limited as I believe it can possibly be. Hope this might help someone down the road.