+1 for more time on gravel to gain more experience.
I have no problem descending on the road at 45-50mph, love it! Gravel is a very different story, I'm still not confident on fast descents on loose terrain. It will just take some time for me to get used to the bike handling off road, no need to rush it, it will come as I ride more.