Good to hear you're making some progress. I really think this bike is the perfect project for you to get your hands on some tools (as you are) - well done!
Looks to me like the front wheel is not centered, so it is either improperly dished or is not fully seated in the front dropouts. try releasing the quick release, wiggling the wheel in the dropouts and re-tightening the front wheel QR while the bike is upright, with a little downward pressure on the stem to seat the axles.
If that doesn't do the trick, then you've done what you can do with the calipers until you can address the wheel centering.
I still think that a full teardown and Oxalic Acid soak would be a good idea. Rust is like cancer, and a soak will touch every surface outside and inside. Naval jelly will be like a topical application on the spots you can see, but won't get inside the frame where the rust is likely to be extensive.