They are pressed in, a long flat bladed screwdriver will work . there is an edge to the cup,

It's more properly called the upper and lower headset race.

you tap on the inside edge of the race insert . with the flat blade of the screwdriver, go around the edge

not banging on one spot .. opposite sides, alternating..

It's got to be long enough to reach to the far side of the head-tube, of course.