I think the term athlete depends on the definition one has or uses, and as this thread suggests, can vary somewhat with the eye of the beholder. Except as applied to people on formal sports teams engaged in organized competition (and not always then), it can lead to debates that for me aren't very productive.
It's a conclusion, and as it has positive, if not praiseworthy, connotations, I would not use it to refer to myself. I would prefer to say I'm a cyclist, or a hiker, or whatever; and that I enjoy outdoor sports and try to stay in shape. Others may use the term differently than I do, and that's OK.