Perhaps just a saddle bag with a QR? I'm using the Lezyne M-Caddy QR because it's small enough, holds all my stuff (has dedicated sleeve/pockets to fit CO2, levers, multi-tool, and money,) doesn't look awful (relatively) and removes easily.