It's about technique. Unseat the bead from both sides all the way around the rim, make sure the inner tube is clear, and try to squeeze the beads toward the centerline of the rim. This is the smallest diameter section of the rim and should make the tire "loose" enough to remove. Pull on the tire as you do this to keep it tight on the centerline. I think this is your problem because you said that installing the tire was easy.