Either your roads are super hilly, you're riding in the wrong gears, your bike doesn't fit you, or you're really really out of shape. I hadn't ridden in 10 years and was able to do 5 miles without much effort.
And you can't say that you flipped over the handlebars and not tell the story.