All the time.., not the neck pain, though.

Center of town is upwind from my Apt, in fair weather.

A peninsula, go around .. head wind at near sea-level,
or hard climb over the hill, is the choice.

neck pain is your posture on the bike, I guess..

may be how it fits needs work, yes, another guess..