You'll probably feel that when spinning the crank by hand but maybe not while you're riding it. If you can't replace the spindle for whatever reason then you don't have much choice. But with that much wear I'd be willing to bet it'll wear out the ball bearings prematurely.