+1 As long as the part that shows is clean, I don't see the point.

I also don't worry about removing all the glue residue from tubular rims.