Don't know why I didn't think of this earlier (or maybe I did; this thread has been going a while

), but for me, "faster" doesn't matter as much as "more comfortable".
When I look at it that way, anything on my back is less comfortable than putting it on my bike.