What goes in my bag that I have on the bike at all times:

Spare tube
Patches and glue
CO2 inflator and spare cartridge
Tire levers
Multitool

For a long ride, I'd have that bag, plus:

Both bottles on the bike
Pack of Shot Bloks
Around 5 bucks, just in case
Cell Phone
ID