Thanks for the answers.

My bike is twitchy at low speed.

My fork is a very stiff aluminium one, so changing for 50mm rake one will not change much. I think I'll change the tires for Michelin (more supple tires), and a more absorbant bar wrap (maybe two wrapping).