You just need to wet sand it but there is no need to take it all the way down to the primer. Also you don't need to sand every little detail. You are likely to sand through if you do - particularly where there is an edge so take care where there are transitions. Also keep your strokes always going the same direction on a tube. If you don't, you will see the sanding marks through the clear.