My initial thought of a bent derailleur hanger was correct. The mechanic at the co-op and I both looked and thought it wasn't bent or was only very very slightly bent. We were wrong as it was bent enough that there was a half an inch difference between the top and the bottom of the wheel. Now oddly it looks bent but is straight. It shifts fine. Six bucks of shop time well worth getting it properly straightened.