I love my Ortlieb Bike Shopper pannier. It's waterproof w/ a sealed zipper type closure at top. The mounting system is great too. It's a little pricey, but IMHO, well worth it. It looks kinda cool too.
Aeneas is correct. Using one pannier will in no way affect your handling once you get going.