It's the engine
I think it's about 10% bike and 90% engine. If I go on a 50 - 70 mile ride on my fixed, my average speed is usually about 1 mph slower than a similar ride on my geared bike. That's a pretty minor difference. So whether or not I'm getting dropped has a lot more to do with who I'm riding with than what I'm riding or what they're riding.