Just like anything else in life, it takes practice. Start going down hills, going a bit faster and faster each time. Soon enough, you'll be good enough where you won't remember your fear at all!