How many speeds is your chain? And do you happen to know the brand on the chain?

Don't push the pin back in, btw. Most chains aren't made to be opened and closed that way anymore. I would buy a connecting link of the correct width. KMC makes them for 6-speed on up.