A bit of rod and a hammer gets headset cups out in a pinch.

Just make sure you move it around enough not to angle the cup more than a few degrees.

If you don't have a long enough bolt to rig up a press, just use a bit of wood and a hammer to get the new one in. Again, be careful not to put much angle on the cups.

Pro mechanics will recoil in horror, but it works fine.