In the heat, panniers stay much cooler. In the winter, I prefer a backpack because the weight is on me, not my bike. It seems easier to catch me / the bike if the bike has less weight. I find backpacks more convenient all around though.