So glad I found this. I feel like an idiot, but I had routed my chain around that outside tab. I rode like this for quite a bit too, hope I didn't do any damage to my derailleur or chain. It seems to run like butter now though!