Panniers are my primary cargo device. I don't like riding with a backpack at all. I can usually fit a change of clothes and a small lunch into one small bag. You do need to have the correct type of rear rack to hold them.

A trunk bag, or even a basket can also work well. With a basket, you'll want some sort of bungee or net to keep stuff from flying out.