If the chain's rusted, I would definitely go on replacing it. Maybe mess around with saddles, handlebars, and pedals. Find a balance you really like. Perhaps you're a bullhorns type of guy, and you like a good toe-clip setup.
My first question: Does the bike have foot retention?. If it doesn't, I highly recommend purchasing some pedals, clips, and straps.