I hope so! It's what I've been doing. I've strong cycling, fair run and absolute newbie swim - I can get more time improving my swim than anywhere else.
The only problem is, swim training, because I'm new and weak, is tough, mentally and physically. It's a lot more fun to go for a 6am run or a nice summer evening bike ride than to go backinto that... damn... pool... for MORE drill. Takes mental strength to train your weak bits.
(Can you tell I'm putting it off?)