No, wind still has an impact. A straight crosswind in both directions slows you in both directions, which is different than headwind/tailwind, and much different than no wind. Also, there is the possibility of timing a storm front with a wind direction change and having a tailwind both ways. You'd have to run some models to figure out the differences, but I'm sure someone else has already run them if you're feeling lucky with Google.