Check Performance Bike. This is the time of year when winter clothing goes on closeout.

Think about finding a wool jersey or two. eBay is a good source. A good wool jersey will do the work of two layers of clothing. I live in Florida but it gets into the low 20s here, and I've ridden 20 miles in knickers, a wool jersey with a wicking shirt underneath, and a cheap Performance hi-vis yellow jacket.

As for gloves, that's difficult to recommend. I really like my Spenco Ironman gloves. I have a full fingered pair and a summer glove. They're great and the gimmicky palm padding works.