I ride daily with a Chrome Kremlin (the huge one) and I've never had problems looking over my shoulder. I think it's really important to keep the flap strapped down tight, otherwise it can bunch up and get in your way.

Chrome makes great bags, though definitely not cheap. I lucked out and scored mine for $40 on eBay.