If you can tighten the cassette with the spacer in place, you need the spacer. Loose cassette cogs will damage the freehub.
With the spacer in place re-adjust both derailleur limit screws and cable tension.
BTW, the highest speed cog is the smallest.