Make sure you get the thick-ish cloth kind, not the electrical tape-looking crap. It might be $4 for a roll instead of $2.

While you've got the old rim tape off, take 36 seconds and run your finger around the inside of each nipple hole. If your finger is bleeding when you finish, there's probably some burrs you need to work on with some sandpaper or a file.