You can just tighten down the frame that extra 3mm. Or add a spacer(s) to get your rear wheel to 123 if you go with a 120 wheelset (which is likely what is happening when you buy the 123 anyways).

Just be sure to maintain a straight chainline either way.