I don't know how long you are swimming for - but I've been swiming for about 8 weeks (I'm up to 1hr sessions) as part of my training for an ironman next year. I have to say that swiming is the best overall workout I have ever done. The legs are worked out, but not as much as cycling. However - it would not take long to get them back if you keep the swimming up.