I'd get it off. All the plastic will do is trap water against the finish. That never turns out well. As rootboy pointed out, a heat gun will soften any adhesive on the plastic. A blow dryer may provide enough heat.