I just saw this the other day in a local hipster bike shop - looked pretty nice, but didn't really have a use for something like this for myself. THE POUCH - Linus Bike
Might be big enough?

Alternatively you could try an old school handlebar bag like they use to ride in the '80s, and just remove it as needed - Lone Peak makes 'em, Handlebar Packs