Center-to-center.

It's measured along the line of extension, so effectively two stems of the same length, but with different rise angles, will provide a different distance between the center of the handlbar and the steering axis. Just something else to take in to account when you're changing stems...