Ugh, I feel you. Usually bloody thumbs for me too.

Recently I'm so frustrated and defeated at the end that I give up and use a tire lever to pry the tire back on even though I know I shouldn't (and have ruined a couple of tubes that way).