When riding aggresively, I put backpack on my back and go.
When taking it less fast, I put backpack on rear rack and tie it with bungee cords.

Considering buying panniers for packing more stuff on paved road rides (work commute, groceries etc).