If your bike weighs 20 lbs as a fixed gear, you have a heavy frame. Getting a light frame would save more weight than wheels in this case. Both are important though...saying which is more important is difficult without knowing how the frame fits you vs how good your current wheels are.