I use this:
http://www.amazon.com/Banjo-Brothers...rocery+pannier

with a large reusable bag.

With panniers that hang off the side, it's not a big deal to have only one. The low center of gravity greatly reduces the effect on stability.