A couple of years ago I was riding 39 frequently after work and would be exiting Azusa canyon about 5:00 or 6:00 about the time the sundowner winds pick up. The Crosswinds out of the side canyons can be really surprising and unpredictable as to which direction they will shove you. Exiting the canyon when it becomes a pure tailwind is like being shot out of a cannon.
It doesn't take much to produce a big change in crosswind sensitivity. I could feel a big difference between 42 mm cross tires (Conti Cross ride)and a 25mm / 23mm racing set. (Force/Attack) on the same wheels.