Ortlieb's shopping pannier, has a long sling strap for shoulder strap, Zip closed
of course the panniers have a strap too.. it clips on/off.

If you had a Brompton, with it's front end clip, their A bag is like a leather briefcase.