I think you have figured it out by now.

In general, a geared bike is faster downhill and slower uphill (and possibly into corners). It is the slower part that really kills your average speed; the downhills don't make up for it.