"only a couple times" may be the issue.
My first few times out were a disaster, but I got the hang of it. It's frustrating, especially with the high standards you appear to hold yourself to.
If you want a more strategic plan to getting better, find a how-to video on a specific skill/obstacle/area for improvement and practice those specifically. Even if that means riding the same section over and over again. Once you feel you've improved sufficiently enough on that, move to something else. Increase your ability by focusing on one or two skills at a time, rather than trying to be the best at every single thing immediately.
Just my $0.02