When I shift a lot I find myself spinning in a gear and sometimes forgetting to upshift, so my speed is lower. I switched from downtube not fixed gear but the same might apply. Used to spinning at a high cadence it doesn't occur to shift unless you think about it. Give it a few hundred miles and I'll bet you're blowing your old speeds away.