I'd get rid of the kickstand and housing, but I'd leave the cable braze ons. How much do cable braze ons weigh?

Check eBay for a stem from a Continental, the Conti stem and bars were alloy -- very light and high quality -- and they are a direct bolt on for the Varsity fork.

You can see what I did with my Varsity here:

http://www.bikeforums.net/showthread.php?t=128775