With the tailwind, you don't get the full benefit of extra speed due to the increased drag.
You are more slowed by the headwind than you can make up with the tailwind.
That's assuming that the wind doesn't change speed and directions over the duration of the ride.