I should play with a trail calculator more, 3mm of atc and 2mm of rake makes that much difference? Huh

But going to less trail will increase the "twitchiness." You will get used to it.

One of my friends bought a used bike with a replacement fork. It must have had a longer ATC and possibly less rake than stock, because it really didn't want to turn at low speeds. Looked perfectly normal.