I suppose it depends on what you mean by a nuisance. It's about as much trouble as taking off a wheel that is bolted on. I.e., it should take less than a minute once you've done it once or twice.
But you don't have to swap out the skewers at all if you're just putting the bike into a rack.