It will be just as fast.

You won't even need the second wheel-set (unless you want to get some 44 mm Rene Herse treaded -- but get 48mm if they fit).