My advice would be to get a high-viz vest. That will provide all of the wind resistance you need, and you can wear it day after day. Craft and others also make wind-resistant base gear (t-shirts) but they are not inexpensive and you would need several of them. So I would opt for the vest first.
I've got a Pearl Izumi and it's worked well for me over the past 10 years.