Yes ... layers. When it comes to base layers and that sort of thing, you don't need to go cycling specific. I wear running jerseys, polypro, and merino wool.
But when it comes to jackets ... you need cycling specific. And for me, long pit-zips are the key!