Uphill- no difference. It's all static weight.
Level, downhill- depends on how aero you get. If you drop down to gain speed, that backback might slow you more than a rear rack pack. If you use wheel side panniers, you're delivering papers again and not flying.
I prefer on bike so when cornering I don't run the risk of weight shifting and changing my arc.