weight is farther back on the rack = bigger rear tire contact patch
weight is farther back on the rack = more weight on back tire = bigger contact patch = more drag on that tire? Sure the front will be lighter with a smaller patch, but I don't think the relationship is linear.
Put a little more air in the back tire when you rack mount your pack and see if it makes a difference.