No, sand it down first. That way, you know that it will be smooth, and you will not have to spend extra time around that area, which could rough everything else up.