The long sleeve tee under your jersey is a great idea (as long as it's made of some kind of polypro or spandex, NO COTTON). For pants, you can get a pair of knee warmers that cover a lot of your lower leg (if you have short legs like me), or full unpadded tights over your bibs, or padded full length bibs. They all exist and have different uses. For me, I wear just short bibs when it's warm, short bibs w/knee warmers when it's cool, and wind-proof tights over short bibs when it's really cold. Anything colder, I would throw my vented snowpants over my bibs.
Up top, your layer is a good idea next to your skin. Over the jersey, you can throw on a fleece when it isn't windy, or a wind vest over the top of that when it is. Alternatively, you can wear a windproof jacket instead of the fleece and vest.