Depends how often you're going to swap. A couple times a year, tires are fine. But if you're doing it on a weekly basis you'll want a whole wheelset (or separate bike) ready to go.

Another solution is getting tires that work for both conditions. I also suspect that the Marathons might be better offroad than you think. Try them first.