I have a friend that lives by the coast, and whenever I go on a ride with him there is a crosswind the whole time. Doesn't matter which way you're going, you always have a crosswind. I didn't like that.
When I went to school in Merced, it was similar to the OP - great tailwind one way, headwind going the other way.
Think of it as "resistance" training?