Alright. Given that doing what I did is marginal anyway (doubly so on aluminum; my handlebar/stem were steel), your best bet is probably to change both the stem and bars. The stuff holding the saddle and the steering column are really safety-critical parts of the bike, so it's worth it. You'll need to pay some attention to dimensions and sizing conventions to get parts that are compatible with your steerer and with each other. Drop a line here if you get confused.