Think of chainring circumference in links, not chainring diameter. The chain engages only half your chainring, so the new chainring will want only two more links, the smallest unit you can normally add or remove.
Will you need to add links? Maybe not. Try pinching a couple of links together with the bike in bottom gear, to see if there is two links worth of slack available without stressing the derailler. As for the advisability of just adding a link pair, that will depend on the wear state of the current chain. Also, two "quick link" master links just a link apart may not be a good idea - others will advise I am sure, I have no data/experience on that.