Depends on how you ride. 23's are slightly lighter and will give you less air resistance. This makes them better for climbing and riding fast. However, if you're not going fast and need something for commuting or rec riding, 25 may be better.
Like nocondorfx says though, it's basically just 2mm. You'll barely notice.