I used Goof-Off to clean the old glue off the rims, for tubs, from time to time. Be certain you wear rubber, or solvent-proof gloves, if you use it though.
I learned about Goof-Off from professional painters on our construction jobs, it will remove pretty much adhesive that you can find, and does not leave a residue, just keep it away from painted surfaces. No problems with anodized aluminum parts, however.
Bill