Here's my thoughts because I'm bored, not because I know anything about the subject...
Here's a random local Time Trial result, I think this is a 20k: http://www.ic3-ntx.org/2011_March_Results.pdf
23 mph would give you a time of 32:24, which in the men's 4/5 would be good for 24th place.
If you could add half a mph to that, for 23.5 mph, that'd put you at 31:44, which would be good for 21st place.
So the question, what's that worth to you?

Realistically, try to do more research and see what that does to your speed. I just assumed the 0.5 mph increase, and don't know what it actually runs.
If you can get results from your local races, that'd be a better time comparison.
Jump over to the "Racing" part of the Road Cycling Forum, and some of those guys will have all the answers.