The OP is correct that he decelerates more quickly than his big-wheeled brethren when he stops pedalling, but he can take heart in the fact that it doesn't take much effort to catch up again. The small wheels quickly lose momentum when you stop pedalling, and quickly regain it when you resume your efforts.