Look ahead, brake early, and weight the outside pedal. Practice will help but at some point you wil descend as fast as you are going to. What I mean is we don't keep getting faster as we get older.
Eventually you will find your comfort level and not push through it. I know I did some years ago. If a bunch of 20 year old (or 40 year old) riders want to drop me on a descent, that's fine with me.