I usually prefer a backpack. It's easier to put on than the panniers, and offers less wind resistance. Plus it's easier to carry the load on my back than in the pannier when walking through the hall and down the 2 stairs at home and when wheeling my bike in/out of the office.

The backpack puts the weight on your back and makes the bike feel lighter, panniers put the weight on the bike and make you feel lighter.