You have nothing to worry about man. Some hills are just faster to walk then ride, and walking is still exercise. It won't be long before you're riding hills you used to walk and walking hills you used to not even dare trying. Lather, rinse, and repeat.
oh and yes this has completely happened to me.