I did that one time and ended selling the road tires, it looked horrible. It is ok to get road tires, but stay within 2 inches or more. The difference in speed is very minimal, besides more punctures etc as there is a reason why use a mtb for the road.

Have a clean drivetrain, the wheels trued and proper air pressure to get good average speeds.