I carry a cheap schwinn foot pump in my trunk bag. The bag comes off and goes with me whenever I lock the bike up and go inside a building.

I know CO2 works well, is more compact and is lighter, but I only paid $10 or so for the pump and I use it regularly.