Depends how good you want the results to be.
But yes, for a cassette freehub, generally just a bunch of spacers with one cog will get your chain line correct and stop the shifting problems.
With vertical dropouts you'll have some chain tensioning issues that will require experimentation with different cogs and maybe a half link.
Check the Sheldon Brown pages for conversions.