You might luck out and be able to swap without any adjustments, but don't expect it.
The thing is, you can easily keep track of how much difference between wheels and just remember to turn the barrel adjust X amount when swapping.
Since the bike already comes with something like an 11-32?, I'm not sure how much lower you can go. A 34T cog isn't going to do very much from a 32.