Turns out I am just an idiot. Since I thought I would be replacing the chain rings I didn't pay attention during removal. I somehow thought it was best to put the largest chain ring behind the crank spider mount. It seems to all be working now. I'm just tweaking the barrel adjustment to get crisp shifts.
One last question on this, will the wore down chain rings ruin my chain faster than normal? At one point should I be going for new chain rings?
Thanks!