There's nothing wrong with that at all. The clearance on my Dodici Gara with Sugino 75s is probably less than that and I've never had an issue with the arms hitting the frame.
FWIW - those spacers aren't for increasing Q-factor or adjusting chainline.