I've long contended that if you don't know how to remove the "plastic thing" without destroying it, you should leave it on...but I realize that's a pretty snarky attitude.

More importantly, it sounds like you (OP) need to leave it on, at least until you've had a chance to take your bike to an experienced mechanic for a rear derailleur adjustment, because right now that plastic thing is doing its job.