Here is an easy way to remember (at least for me anyway) I have owned a bike shop for 15 years or so...

With the bike upright (in a stand is nice) put the pedal wrench on the pedal and pedal the bike forward.
Same thing with either side.
If the wrench is being held on the pedal and the bike is pedaling forward, you are removing the pedals.

Good luck.

Dave