My understanding -- and I have no expert knowledge of the subject -- is that the prevailing winds at ground level are strongly affected by local geographical features such as body of waters (lakes, oceans, etc.), hills, mountains, and forests. For example, if there is a strong wind blowing from north to south, and you are heading north up a hillside, you may not even notice the wind because you are sheltered by the hill. While riding along the shore of a lake, the wind
off the surface of the water may be more noticeable than the prevailing wind that you may experience inland.

In short, the direction of the prevailing wind may be less important than the influences of local geography.