Just put miles in. It takes a while to build up to a good XC racer level.The guys that pass you are most likely on a training regiment. Heck I don't care who passes me,I has nothing to do with the how much fun I am having.If you want to feel really bad,track down a pro level rider and try to tag along on a ride.