You can pretty much go as far as feels comfortable with a normal L shaped allen key (maybe 10cm or so on the long side of the L?) for the stem to be plenty tight enough.
How can the fork slip out? Surely the pressure of it being on the road would help to keep it in place even if movement did become possible? Please explain as I think I'm missing something crucial here.