Yes, remove the spacer and it'll work. You'll also need to adjust your front derailleur high/low so it doesn't drop the chain. Other differences is the rear derailleur as it's probably a long cage one and your chain is probably longer than a double chain. But unless your shifting is poor after changing it to a double, I wouldn't worry about it until these parts wear out.

Personally, if it was me and I wasn't having any shifting performance issues, I wouldn't worry about it the way it is currently. If you don't use the small ring, simply don't use it. Tell yourself it's a double and have fun riding.