Learned to ride when I was in college at the local lake which had a few oddly well-kept trails. I got to the point where I was really humming through them and thought I was all that is man.
Brought the bike back home to the local trail I had never been to and was served a piece of humble pie like I never knew existed...
Went from flat, flowy single-track with lovely views to where it looked like rocks and roots were having a turf war and suffering heavy casualties. Stuck with it. After the third ride or so I wound up spending more time in the saddle than walking. Crashed all the time. Got lost all the time. Stuck with it more.
Now, while I don't pretend to have NEAR the cardio of the good riders out there, I know that my skill set is at least average. And it's so much more fun than the college trails. I love it.
Change will suck. You'll figure it out. Then the change won't suck anymore.