Thanks for all the posts trying to figure it out, but today I think I got it. A short while back someone posted about saddles and how they tried a new saddle and really liked it which got me to thinking that I have one of those in my parts bin. I dug it out and swapped it a couple weeks ago and just noticed today that tire wear is right down the center and I'm no longer leaning off side. I haven't dug the old seat out of the bin to see if there is something weird going on with it, but it was definitely the problem. New seat is much more comfortable too.