I've used 23's and 25's, and it's just a middle of the road riders opinion, but I think if you're not "racer weight" and you're more average weight, 25's are better in every way except one. That one way is if you have a super responsive bike that's older and build to handle a certain way with 23's.
I think with an average person of average weight, there's no advantage to 23's. You're a little slower, a little less grip, etc.