Thanks Simplygib.
Ok I did move the front panniers back almost as far as they can go and steering stabilized a lot. The elevation of the bags makes it impossible to have normal steering but it's getting much closer. I got some studded tires so hopefully I can load up the bags and find a nice decline to test them out on soon.
I tilted the bar bag up in order to be able to see in it easier and so I could see the map case.
I am starting to notice the titanium flex.
I'm getting the hang of the bike more. That front rack is really sturdy, much more than I needed for a road trip to be honest. If you are reading this I suggest looking at cheaper racks if you don't plan on touring off-road.