I have a bag on each bike I use that holds a bike specific tube and a couple tire wrenches. Both bikes I use for commuting have a frame or mini pump. In the shoulder bag/briefcase I keep a cable, bike multi-tool and patch kit. I always carry a Leatherman Wingman multi-tool wherever I go. If that doesn't get it, take the bus.
Marc