Like most things, it depends on experience. If you practice, you'll get good at it and be able to do it safely - in the right circumstances.
I used to ride with someone who could descend at quite high speeds with his hands behind his back, steering with his hips. Good bike handler.