I ride with a couple of guys older than you who have slicks on their cross bikes, and if they ever miss a Saturday ride it's to go to a cross race, on the same bike, with knobblies. If you do feel that upgrade sensation burning a hole in your wallet, get a nice light set of road rims with a narrower cassette and slick tires.