Moving the entire crank out may solve your problem, and it definitely will if you move it far enough, but I don't think it's a matter of less than 1mm.
The chain coming from 4+ mm farther out and as you move the crank out both rings are moving together. You might be able to shim it easily dopending on the vintage of 105, modern external BBs being the easiest.
The other option is to make 5 thin spacers (here 1/2mm is probably enough) and move the outer chainring out that far, increasing chainring separation. Don't get carried away, too much space and the chain can crop between the rings on downshifts.
__________________
FB
Chain-L site
An ounce of diagnosis is worth a pound of cure.
Just because I'm tired of arguing, doesn't mean you're right.
“One accurate measurement is worth a thousand expert opinions” - Adm Grace Murray Hopper - USN
WARNING, I'm from New York. Thin skinned people should maintain safe distance.