Well here's an update on my day. I went to a local bike shop to see what they had. They have an Allez Sport on a blemish list for $779 (retails for $940). Didn't see any blemishes on the bike but he said it could have been used for a show bike and there may not be a scratch on it but they're required to say it's a blem item. I took it for a stroll and fell in love with the drop down bars. When I asked him his opinion on my Sirrus Sport, he said I'd end up spending more customizing it to turn it into a road bike than I would by trading in my sport and spending the difference for a road bike.
The general consensus seems to be that I won't get a huge speed bump but I'll be able to go longer more comfortably?
He also let me give clipless pedals and shoes a try on a mounted bike and I think I looked like a clown trying to clip in. Haha. I may decide to do that in a few months to get the added benefit but I think I'd like to get a lot more comfortable on my bike before I step into something like that.