Unless you live in a flat area or are just commuting then I'd keep both chainrings. You're still riding multispeed so why not keep it as a double crank? I don't think the looks will be affected that much