Unless I already had extra steerer left above the stem I would prefer to change the stem.

I'm not concerned with stem aesthetics though. Keep in mind that raising the stem also brings it slightly closer, so the best solution may be a higher angle, but slightly longer stem.