A few folks make hip pouches (like fanny-packs, only with lock-holders) for just this purpose. I believe ReLoad is one, and I know Dank used to make them too, but they don't exist anymore.

This is assuming you are saying you have a U-Lock, of course. If it's a chain, bite your anti-hipster tongue and wear it.