The missing bearing would not cause what you were seeing. I've run into several hubs like what and all spun free and straight.

It is possible that a very loose cone could have 'jammed' in the hole made by the missing bearing, but should have been easily movable and obviously loose when you wiggled the wheel laterally. (Did you?)

Most likely it was just in the dropouts crooked.