Dunno, I feel like wearing a backpack makes me feel slower and less manuverable, and definetly less comfortable.
Putting it in the rack means less weight shifting around on my shoulders, so less work keeping balanced, more focus on pedaling fast, etc...