My first rides were only a mile or two and they exhausted me. Now, 2 months later my longest ride is still only 14.5 miles. But I feel myself getting stronger each ride, I have already lost inches from my hips and stomach, and lost almost 10 lbs.
Don't be too hard on yourself! Enjoy riding and you'll keep doing it.