Those torque recommendations are maximums, not requirements, and the carbon fork steerer takes precedence so follow and do not exceed it's recommendation. That said, even 5 N-m is more than enough to keep the stem from slipping and that's all you need to accomplish.