If you're not racing and want to be free of saddle bags, try a lumbar bag. They're actually designed for hiking but can do reasonably well for cycling. MountainSmith makes them and can be found at most REI stores.

Mountainsmith Kinetic Tls Waistpack

But here's the disadvantage, other than being accused of being too Fred. If you stuff too many things into the bag and cause it to be on the heavy side, it will droop and the waist retention system will cause the buckle to lose a grip on the nylon strap. What I do is to make sure at the beginning of each ride that the strap is tight on the waist.

I called REI on this and also called MountainSmith as well. MountainSmith gave me two plastic retainers that cause a loop on each of the two nylon straps. This is suppose to reduce the tendency of the weight of the bag's contents to pull down on the straps. Does it work? Somewhat.

The advantage of a lumbar bag is that the need for a saddle bag goes away and the need to stuff things in the back jersey pocket too. Also, when stopping for a coffee and roll, everything like wallet, keys, cell phone, all go with you instead of on the bike.

If you aren't racing, then it's an alternative. This bag is even big enough to fit the Kool Stop Tire Bead Jack. Sheldon Brown recommends this. And since I have 50mm carbon rims (PSIMET) and Continental Grand Prix 4000-S tires, it works fine.

One other thing, that MountainSmith bag has an outer pocket. It fits my Road Morph pump but vertically and I tie it down with a velcro strip that loops onto the bag's own loop.