Here is a hint, when steering with a higher front end move your hips forward. You will find, especially at speed, that your turning is MORE stable, not less. Downhillers are some of the fastest at taking turns and their front end is signifigantly higher than their rear. Watch motocross too. Same thing, they are basically humping the bar into turns.

I am not saying not to go to rigid, all the power to you, but you could change your technique and end up faster.