Twitchy when? going slow or fast? Touring bikes traditionaly have less steering trail and will feel more stable at low speeds. Unloaded touring bikes often (IMO they should ) feel "twitchy" at higher speeds since it's intended use is for touring with the weight of panniers and handlebar bags. Sorta like a pickup truck rides better when it is loaded down.
There is a tradeoff, You might reduce the twitchy feeling somewhat by using the 50 mm fork but if you later add 50-70lbs of touring weight for a tour, the steering will likely feel heavier. If you ride the unladen bike enough you will likely get use to the sensitive steering by learning to use less steering input