Depends on how cold the weather is typically going to be.
I can stay fairly comfortable with just compression wear or a cheap base layer I used for snowboarding.
But If you're routinely riding in temps well below freezing, you may have to invest in some quality gear.