Go easy on your stem as you pry it, it's aluminum (I bet) and excessive force might stress it and risk a catastrophic failure later.