Johnny, I agree with Enthalpic in that you definitely need recovery days. However, recovery days don’t mean that you shouldn’t do anything. Active recovery, such as very easy spinning, can be more beneficial than doing nothing since you increase blood circulation to the muscles without tearing anything. The only thing is that you need time and motivation to do that. I would suggest that on two days of the week, you do nothing but easy spinning on your bike (like commuting to work for example). If you really want to, probably add only upper body weight work at lunch hour on Tuesday and Thursday, but then again, you are already doing 180 laps of the pool (25m ones) every week. So your swimming should be strong already.
How old are you? If you are about 30 pounds heavier than you optimum weight, I would suggest starting off very easy and increase your load gradually over time. Try to loose only a few pounds a month and watch out for over training. Good luck.