At those speeds, the change in aerodynamic drag (less frontal area on narrower tires) will probably be just as significant as the change in rolling resistance. By the way, while you're making the change, get the extra-light ~70-gram tubes to go with those tires too.
Also recalibrate your computer so it gives you accurate speed readings with the smaller tires.