Back pain is debilitating. Going a little slower isn't.
The last time I bought a bike off the rack, they offered to have me take it home and they would swap the stem later. "That's ok, you hold on to it, I won't be riding it until it fits properly anyway."

Helps that it was, for them anyway, a higher end bike.