Thanks. Upon further review, I don't think the pannier ever touched. As Muchkin said, I think it was the weight that got me. I didn't feel any difference when doing normal left handers but this one I leaned pretty good and I think the extra weight just gave me too much lean and ... bye bye.
I'm an idiot for not thinking about this ahead of time. This morning my left wrist is pretty sore (hurts when I type). I still rode in though.
