I don't like toe clips for that reason, though for any riding at all. Full "clipless" pedals provide little or no efficiency benefit (it's debateable whether it's a little or none, but either way it's definitely not huge). Toe Cages are the worst of everything - no additional grip for pulling up, foot it trapped on the pedal.

You can buy flat pedals with pins, these are the cheapest good pedals I know of (around $50):

VP Components VP-Vice Pedals
Amazon.com : VP Components VP-Vice Pedals (Pack of 2) (9/16-Inch, Black) : Bike Pedals : Sports & Outdoors



I like Chrome flat bike shoes because they look relatively normal and are very comfortable for biking (funny enough not as comfortable for walking around off the bike but they're ok). I own a pair of Chrome Kurk's. I think was thinking of buying the Storm Kursk's (waterproof version) for winter.

If you want super, super, super grippy, you can buy Five Ten Freeriders:
http://www.amazon.com/Five-Ten-Mens-.../dp/B008XES5S4



I actually found them a little *to* grippy, with all the pins on my pedals I had to lift the shoe off the pedal just to twist it to change shoe position.

Just fyi - there are a lot of good options for doing "flat" pedals that still keep your feet pretty firmly attached to the pedal, but also let you pull it off the pedal quickly if you want to.