When the weather gets cool, which for me is the 40's and 50's, I wear a BCG polyester, long-sleeve t-shirt (Academy Sports) as a base layer. Usually, I will wear one or two short-sleeve cycling jerseys over the base layer and top it off with the wind jacket. These jerseys are the typical wicking type jerseys, three pockets in the back etc. I like the full-zip jerseys as they allow me to unzip a little as I begin to warm up.

Based on my experience, it takes a while and some trial and error assemble a wardrobe for cool- and for cold-weather riding. You're off to a good start with the wind jacket. A few years back, I bought a long-sleeve jersey thinking it would solve some problems, but the wind cut right through it. Once I had the wind jacket over this jersey, the jersey was able to do its job. Stay with it, you'll get there.